租户下手动合并长时间未结束，集群无法重启

烫烫烫 · 2025 年11 月 27 日 11:40

【使用环境】测试环境
【 OB or 其他组件】OB
【使用版本】V4.3.5_CE_BP1
【问题描述】租户下手动合并长时间未结束
【复现路径】问题出现前后相关操作
【附件及日志】测试时新建租户1C2G3副本，手动执行合并。目前已经过去了17个小时，依然显示合并中。尝试点击暂停合并，系统报错partition has not leader，无法暂停。

然后尝试增大规格，通过修改Unit为2C4G，依然无法奏效。
尝试重启集群，会卡在第1个Stop Zone步骤后，30分钟超时。
请问该怎么解决？
@论坛小助手

论坛小助手 · 2025 年11 月 27 日 11:41

推荐使用 obdiag 工具进行根因分析和日志采集，这可以帮助我们确定问题的具体原因并提供解决方案。以下是具体的步骤：

根因分析场景: 卡合并场景
根因分析命令: obdiag rca run --scene=major_hold
日志采集场景: 合并问题
日志采集命令: obdiag gather scene run --scene=observer.compaction

请您按照上述命令操作，并将采集到的日志压缩包提供给我们，以便进一步分析问题。此外，为了更有效地帮助您解决问题，请您提供以下信息：

手动合并在何时开始的？
在手动合并之前，集群是否运行正常？是否有异常情况发生？
集群配置信息，例如硬件配置、版本信息等。
当前集群的状态和最近的操作记录。

附上敏捷诊断工具 obdiag 使用帮助链接

zhenxing · 2025 年11 月 27 日 17:56

可以先按文档步骤走一轮
https://www.oceanbase.com/knowledge-base/oceanbase-database-1000000000685150

看报错是有【partition has not leader】，先观察下集群服务器是不是正常，报错没leader，合并不能触发是符合预期的

辞霜 · 2025 年11 月 28 日 09:59

建议使用obdiag采集一下合并卡住场景信息。
截图提供一下目前集群状态信息

KDKD · 2025 年11 月 28 日 11:32

您好，根据文档内容，我们做了如下排查：

1、发现是 1016 租户合并不成功，没有 ERROR

obclient(root@sys)[oceanbase]> select * from CDB_OB_MAJOR_COMPACTION;
+-----------+---------------------+----------------------------+----------------------+---------------------+----------------------------+----------------------------+------------+----------+--------------+------+
| TENANT_ID | FROZEN_SCN          | FROZEN_TIME                | GLOBAL_BROADCAST_SCN | LAST_SCN            | LAST_FINISH_TIME           | START_TIME                 | STATUS     | IS_ERROR | IS_SUSPENDED | INFO |
+-----------+---------------------+----------------------------+----------------------+---------------------+----------------------------+----------------------------+------------+----------+--------------+------+
|         1 | 1764266403159254000 | 2025-11-28 02:00:03.159254 |  1764266403159254000 | 1764266403159254000 | 2025-11-28 02:07:26.933119 | 2025-11-28 02:00:03.256094 | IDLE       | NO       | NO           |      |
|      1001 | 1764266402172656000 | 2025-11-28 02:00:02.172656 |  1764266402172656000 | 1764266402172656000 | 2025-11-28 02:07:26.359695 | 2025-11-28 02:00:02.209729 | IDLE       | NO       | NO           |      |
|      1002 | 1764266402436231000 | 2025-11-28 02:00:02.436231 |  1764266402436231000 | 1764266402436231000 | 2025-11-28 02:05:36.975868 | 2025-11-28 02:00:02.548611 | IDLE       | NO       | NO           |      |
|      1003 | 1764266402173713000 | 2025-11-28 02:00:02.173713 |  1764266402173713000 | 1764266402173713000 | 2025-11-28 02:07:26.348447 | 2025-11-28 02:00:02.209574 | IDLE       | NO       | NO           |      |
|      1004 | 1764266401724892000 | 2025-11-28 02:00:01.724892 |  1764266401724892000 | 1764266401724892000 | 2025-11-28 02:04:14.198986 | 2025-11-28 02:00:01.771755 | IDLE       | NO       | NO           |      |
|      1015 | 1764266402189739000 | 2025-11-28 02:00:02.189739 |  1764266402189739000 | 1764266402189739000 | 2025-11-28 02:06:46.062117 | 2025-11-28 02:00:02.226727 | IDLE       | NO       | NO           |      |
|      1016 | 1764148949240376000 | 2025-11-26 17:22:29.240376 |  1764148949240376000 | 1763920804367537000 | 2025-11-24 02:06:17.430320 | 2025-11-26 17:22:29.340710 | COMPACTING | NO       | NO           |      |
+-----------+---------------------+----------------------------+----------------------+---------------------+----------------------------+----------------------------+------------+----------+--------------+------+

2、因为 alter system change tenant META$1016 提示 proxy 不支持还是啥的，所以直接 select tenant_id, module, type, ret, status, gmt_create, retry_cnt, warning_info from __all_virtual_dag_warning_history where tenant_id = 1016;，发现错误是 OB_ALLOCATE_MEMORY_FAILED

3、出问题之前因为资源不足，把 Unit 规格从 1C2G 调整到了 1C1G，调整之前每天的自动合并是 OK 的，调整以后想手动合并一下，就卡住了，将规格调回 1C2G、2C4G 都不行

4、现在发现的问题：

合并无法暂停
整个集群无法重启
数据无法写入到这个租户的表中
在 OCP 中查看这个租户的「统计信息管理」页面，提示 `Timeout query has reached the maximum query timeout: 10000000(us)
看起来是基本的读写都无法做到

4、因为上面内存不足的原因，所以到 OCP 白屏里面对应租户，调整了 3 个 node 的 Unit 规格到 S3：6C20G，目前还是无法读取和写入

KDKD · 2025 年11 月 28 日 11:35

还到 /home/admin/oceanbase/log 这个目录下看了一下 rootservice.log 文件，发现只有 11.28 今天的，之前的日志都看不到

drwxr-xr-x  3 admin admin 4.0K Nov 28 11:00 .
drwxr-xr-x 12 admin admin  167 Jul  3 14:45 ..
drwxr-xr-x  2 admin admin   23 Nov 26 15:54 alert
-rw-r--r--  1 admin admin 636K Nov 28 11:00 election.log
-rw-r--r--  1 admin admin 257M Nov 28 11:00 election.log.20251128110002071
-rw-r--r--  1 admin admin  299 Nov 28 11:00 election.log.wf
-rw-r--r--  1 admin admin  299 Nov 28 07:25 election.log.wf.20251128110002071
-rw-r--r--  1 admin admin  91M Nov 28 11:00 observer.log
-rw-r--r--  1 admin admin 257M Nov 28 10:29 observer.log.20251128102955983
-rw-r--r--  1 admin admin 257M Nov 28 10:34 observer.log.20251128103437110
-rw-r--r--  1 admin admin 257M Nov 28 10:39 observer.log.20251128103932687
-rw-r--r--  1 admin admin 257M Nov 28 10:44 observer.log.20251128104426031
-rw-r--r--  1 admin admin 257M Nov 28 10:49 observer.log.20251128104917631
-rw-r--r--  1 admin admin 257M Nov 28 10:54 observer.log.20251128105413907
-rw-r--r--  1 admin admin 257M Nov 28 10:59 observer.log.20251128105904583
-rw-r--r--  1 admin admin  299 Nov 28 10:59 observer.log.wf
-rw-r--r--  1 admin admin  299 Nov 28 10:25 observer.log.wf.20251128102955983
-rw-r--r--  1 admin admin  299 Nov 28 10:29 observer.log.wf.20251128103437110
-rw-r--r--  1 admin admin  299 Nov 28 10:34 observer.log.wf.20251128103932687
-rw-r--r--  1 admin admin  299 Nov 28 10:39 observer.log.wf.20251128104426031
-rw-r--r--  1 admin admin  299 Nov 28 10:44 observer.log.wf.20251128104917631
-rw-r--r--  1 admin admin  299 Nov 28 10:49 observer.log.wf.20251128105413907
-rw-r--r--  1 admin admin  299 Nov 28 10:54 observer.log.wf.20251128105904583
-rw-r--r--  1 admin admin 5.5M Nov 28 11:00 rootservice.log
-rw-r--r--  1 admin admin 257M Nov 28 10:59 rootservice.log.20251128105915745
-rw-r--r--  1 admin admin  299 Nov 28 10:59 rootservice.log.wf
-rw-r--r--  1 admin admin  299 Nov 28 09:58 rootservice.log.wf.20251128105915745
-rw-r--r--  1 admin admin 117M Nov 28 11:00 trace.log
-rw-r--r--  1 admin admin 257M Nov 28 10:48 trace.log.20251128104824976
-rw-r--r--  1 admin admin    0 Nov 28 10:48 trace.log.wf
-rw-r--r--  1 admin admin    0 Nov 28 10:21 trace.log.wf.20251128104824976

辞霜 · 2025 年11 月 28 日 14:49

select * from GV$OB_COMPACTION_DIAGNOSE_INFO;
select * from cdb_ob_major_compaction where tenant_id = 1016;

辞霜 · 2025 年11 月 28 日 14:50

select svr_ip, svr_port, count(1) from __all_virtual_tablet_meta_table where tenant_id = 1016 and compaction_scn < 1764148949240376000 group by svr_ip; 查询未合并完成的表

KDKD · 2025 年11 月 28 日 14:57

谢谢您的回复，新用户暂时无法上传附件，执行结果：

obclient(root@sys)[oceanbase]> select * from GV$OB_COMPACTION_DIAGNOSE_INFO;
+---------------+----------+-----------+------------+-------+-----------+--------+----------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| SVR_IP        | SVR_PORT | TENANT_ID | TYPE       | LS_ID | TABLET_ID | STATUS | CREATE_TIME                | DIAGNOSE_INFO                                                                                                                                                                                                |
+---------------+----------+-----------+------------+-------+-----------+--------+----------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |    101106 | FAILED | 2025-11-24 18:23:56.804399 | error_no=-4013,last_error_time=1763993561662939,error_trace=YB420B26ECE8-00063922067F5DB4-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=101106;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"    |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |       328 | FAILED | 2025-11-24 18:23:56.804435 | error_no=-4013,last_error_time=1763993561663012,error_trace=YB420B26ECE8-00063922067F5DB6-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=328;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"       |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |       332 | FAILED | 2025-11-24 18:23:56.805075 | error_no=-4013,last_error_time=1763993561663097,error_trace=YB420B26ECE8-00063922067F5DB8-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=332;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"       |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |         1 | FAILED | 2025-11-24 18:23:56.803057 | error_no=-4013,last_error_time=1763993561662404,error_trace=YB420B26ECE8-00063922067F5DAD-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=1;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"         |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |       121 | FAILED | 2025-11-24 18:23:56.803279 | error_no=-4013,last_error_time=1763993561662363,error_trace=YB420B26ECE8-00063922067F5DAE-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=121;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"       |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |       331 | FAILED | 2025-11-24 18:23:56.804550 | error_no=-4013,last_error_time=1763993561662834,error_trace=YB420B26ECE8-00063922067F5DB5-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=331;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"       |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |    101065 | FAILED | 2025-11-24 18:23:56.805625 | error_no=-4013,last_error_time=1763993561663241,error_trace=YB420B26ECE8-00063922067F5DB9-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=101065;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"    |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |       329 | FAILED | 2025-11-24 18:23:56.805492 | error_no=-4013,last_error_time=1763993561663198,error_trace=YB420B26ECE8-00063922067F5DB7-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=329;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"       |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |       333 | FAILED | 2025-11-24 18:23:56.805682 | error_no=-4013,last_error_time=1763993561663346,error_trace=YB420B26ECE8-00063922067F5DBA-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=333;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"       |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |     49402 | FAILED | 2025-11-24 18:23:55.407010 | error_no=-4013,last_error_time=1763993561662519,error_trace=YB420B26ECE8-00063922067F5DAC-0-0,warning="TX_TABLE_MERGE;ls_id=1;tablet_id=49402;compaction_scn=0;"                                             |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |       377 | FAILED | 2025-11-24 18:23:56.803726 | error_no=-4013,last_error_time=1763993561662592,error_trace=YB420B26ECE8-00063922067F5DAF-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=377;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"       |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |    101066 | FAILED | 2025-11-24 18:23:56.805888 | error_no=-4013,last_error_time=1763993561663389,error_trace=YB420B26ECE8-00063922067F5DBB-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=101066;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"    |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |    101105 | FAILED | 2025-11-24 18:23:56.803854 | error_no=-4013,last_error_time=1763993561662809,error_trace=YB420B26ECE8-00063922067F5DB2-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=101105;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"    |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |       323 | FAILED | 2025-11-24 18:23:56.803554 | error_no=-4013,last_error_time=1763993561662679,error_trace=YB420B26ECE8-00063922067F5DB0-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=323;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"       |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |     1 |       519 | FAILED | 2025-11-24 18:23:56.803812 | error_no=-4013,last_error_time=1763993561662736,error_trace=YB420B26ECE8-00063922067F5DB1-0-0,warning="MINI_MERGE;ls_id=1;tablet_id=519;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0"       |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |  1001 |    200016 | FAILED | 2025-11-24 18:24:01.809050 | error_no=-4013,last_error_time=1763993561663453,error_trace=YB420B26ECE8-00063922067F5DBC-0-0,warning="MINI_MERGE;ls_id=1001;tablet_id=200016;compaction_scn=0;exec_mode="EXEC_MODE_LOCAL",concurrent_cnt=0" |
| x.x.x.232 |     2882 |      1016 | MINI_MERGE |  1001 |     49402 | FAILED | 2025-11-24 18:23:59.352364 | error_no=-4013,last_error_time=1763993561662985,error_trace=YB420B26ECE8-00063922067F5DB3-0-0,warning="TX_TABLE_MERGE;ls_id=1001;tablet_id=49402;compaction_scn=0;"                                          |
+---------------+----------+-----------+------------+-------+-----------+--------+----------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
17 rows in set (0.028 sec)


obclient(root@sys)[oceanbase]> select * from cdb_ob_major_compaction where tenant_id = 1016;
+-----------+---------------------+----------------------------+----------------------+---------------------+----------------------------+----------------------------+------------+----------+--------------+------+
| TENANT_ID | FROZEN_SCN          | FROZEN_TIME                | GLOBAL_BROADCAST_SCN | LAST_SCN            | LAST_FINISH_TIME           | START_TIME                 | STATUS     | IS_ERROR | IS_SUSPENDED | INFO |
+-----------+---------------------+----------------------------+----------------------+---------------------+----------------------------+----------------------------+------------+----------+--------------+------+
|      1016 | 1764148949240376000 | 2025-11-26 17:22:29.240376 |  1764148949240376000 | 1763920804367537000 | 2025-11-24 02:06:17.430320 | 2025-11-26 17:22:29.340710 | COMPACTING | NO       | NO           |      |
+-----------+---------------------+----------------------------+----------------------+---------------------+----------------------------+----------------------------+------------+----------+--------------+------+
1 row in set (0.016 sec)


obclient(root@sys)[oceanbase]> select svr_ip, svr_port, count(1) from __all_virtual_tablet_meta_table where tenant_id = 1016 and compaction_scn < 1764148949240376000 group by svr_ip;
+---------------+----------+----------+
| svr_ip        | svr_port | count(1) |
+---------------+----------+----------+
| x.x.x.232 |     2882 |      760 |
| x.x.x.233 |     2882 |      750 |
| x.x.x.234 |     2882 |      750 |
+---------------+----------+----------+
3 rows in set (0.029 sec)

辞霜 · 2025 年11 月 28 日 15:08

当前该租户的规格可以修改么。目前是多大，看报错就是因为内存不足导致合并报错了

KDKD · 2025 年11 月 28 日 15:12

可以修改，昨天先修改到 2Core 4G 了，发现没变化，今天上午改成了 6Core 20G，还是没有变化
这个修改完以后需不需要做什么操作，触发一下之类的？

shigp · 2025 年11 月 28 日 15:13

666666

辞霜 · 2025 年11 月 28 日 15:33

select * from gv$minor_merge_info where tenant_id=1016;

辞霜 · 2025 年11 月 28 日 15:35

是否修改过转储线程数，可能是并发太高导致

Sunshining · 2025 年11 月 28 日 15:38

学习一下，增长经验

KDKD · 2025 年11 月 28 日 15:59

obclient(root@sys)[oceanbase]> select * from gv$minor_merge_info where tenant_id=1016;
ERROR 1146 (42S02): Table 'oceanbase.gv$minor_merge_info' doesn't exist

提示没有这张表，是需要当前集群的 sys 租户吗？我是在当前集群的 sys 租户下的 oceanbase 库里查询的

辞霜 · 2025 年11 月 28 日 16:06

修改过转储线程数么

KDKD · 2025 年11 月 28 日 16:22

没有，您这边有什么修改的建议吗？

编辑：

从 OCP 进到这个租户的「合并管理」页面，点击「合并配置」页面，提示：

Timeout, query has reached the maximum query timeout: 10000...(us) ...

有办法直接从数据库修改吗？

辞霜 · 2025 年11 月 28 日 16:41

select * from __all_virtual_tablet_compaction_history where tenant_id = xx and type = ‘MINI_MERGE’ order by finish_time desc limit 10; 看最近的转储记录

select svr_ip, svr_port, count(1) from __all_virtual_tablet_meta_table where tenant_id = 1016 and compaction_scn < 1764148949240376000 group by svr_ip; 查询未合并完成的表

KDKD · 2025 年11 月 28 日 16:46

obclient(root@sys)[oceanbase]> select * from __all_virtual_tablet_compaction_history where tenant_id = 1016 and type = 'MINI_MERGE' order by finish_time desc limit 10;
+---------------+----------+-----------+-------+-----------+------------+---------------------+----------------------------+----------------------------+-----------------------------------+-------------+-------------------+-------------------------------+------------------------------+--------------------------------------+-----------------+-----------------------+-------------------+---------------------+------------------------------+----------------------------+-----------------+---------------+------------------------------------------------------------------------+---------------+-----------------------+-------------+-----------+---------------+-------------------+-----------------+---------------+-------------------------+--------------+-------------------+---------------+-----------------+--------------+
| svr_ip        | svr_port | tenant_id | ls_id | tablet_id | type       | compaction_scn      | start_time                 | finish_time                | task_id                           | occupy_size | macro_block_count | multiplexed_macro_block_count | new_micro_count_in_new_macro | multiplexed_micro_count_in_new_macro | total_row_count | incremental_row_count | compression_ratio | new_flush_data_rate | progressive_compaction_round | progressive_compaction_num | parallel_degree | parallel_info | participant_table                                                      | macro_id_list | comments              | start_cg_id | end_cg_id | kept_snapshot | merge_level       | exec_mode       | is_full_merge | io_cost_time_percentage | merge_reason | base_major_status | co_merge_type | mds_filter_info | execute_time |
+---------------+----------+-----------+-------+-----------+------------+---------------------+----------------------------+----------------------------+-----------------------------------+-------------+-------------------+-------------------------------+------------------------------+--------------------------------------+-----------------+-----------------------+-------------------+---------------------+------------------------------+----------------------------+-----------------+---------------+------------------------------------------------------------------------+---------------+-----------------------+-------------+-----------+---------------+-------------------+-----------------+---------------+-------------------------+--------------+-------------------+---------------+-----------------+--------------+
| 00.00.000.234 |     2882 |      1016 |     1 |     49402 | MINI_MERGE | 1764208805812387000 | 2025-11-27 10:02:21.710328 | 2025-11-27 10:02:21.718859 | YB420B26ECEA-00063970027D7A91-0-0 |       59386 |                 1 |                             0 |                            1 |                                    0 |              87 |                    87 |                 1 |               22537 |                            0 |                          0 |               1 | -             | table_cnt=1,start_scn=1764208638868818000,end_scn=1764208805812387000; | 62133         | comment="cost_mb=3;"; |           0 |         0 |               | MACRO_BLOCK_LEVEL | EXEC_MODE_LOCAL |             0 |                      16 |              |                   |               |                 |         2132 |
| 00.00.000.233 |     2882 |      1016 |     1 |     49402 | MINI_MERGE | 1764208805812387000 | 2025-11-27 10:00:29.731544 | 2025-11-27 10:00:29.739483 | YB420B26ECE9-0006395FF23EED71-0-0 |       54976 |                 1 |                             0 |                            1 |                                    0 |             141 |                   141 |                 1 |               24290 |                            0 |                          0 |               1 | -             | table_cnt=1,start_scn=1764208523657025000,end_scn=1764208805812387000; | 195120        | comment="cost_mb=3;"; |           0 |         0 |               | MACRO_BLOCK_LEVEL | EXEC_MODE_LOCAL |             0 |                      18 |              |                   |               |                 |         1802 |
| 00.00.000.234 |     2882 |      1016 |     1 |     49402 | MINI_MERGE | 1764208638868818000 | 2025-11-27 09:57:19.796324 | 2025-11-27 09:57:19.804895 | YB420B26ECEA-00063970027D7A8F-0-0 |       65085 |                 1 |                             0 |                            1 |                                    0 |             158 |                   158 |                 1 |               27505 |                            0 |                          0 |               1 | -             | table_cnt=1,start_scn=1764208338744161000,end_scn=1764208638868818000; | 62133         | comment="cost_mb=3;"; |           0 |         0 |               | MACRO_BLOCK_LEVEL | EXEC_MODE_LOCAL |             0 |                      19 |              |                   |               |                 |         1913 |
| 00.00.000.233 |     2882 |      1016 |     1 |     49402 | MINI_MERGE | 1764208523657025000 | 2025-11-27 09:55:27.732199 | 2025-11-27 09:55:27.741066 | YB420B26ECE9-0006395FF23EED70-0-0 |       55220 |                 1 |                             0 |                            1 |                                    0 |             163 |                   163 |                 1 |               20972 |                            0 |                          0 |               1 | -             | table_cnt=1,start_scn=1764208224322606000,end_scn=1764208523657025000; | 195120        | comment="cost_mb=3;"; |           0 |         0 |               | MACRO_BLOCK_LEVEL | EXEC_MODE_LOCAL |             0 |                      15 |              |                   |               |                 |         2155 |
| 00.00.000.234 |     2882 |      1016 |     1 |     49402 | MINI_MERGE | 1764208338744161000 | 2025-11-27 09:52:19.787060 | 2025-11-27 09:52:19.795187 | YB420B26ECEA-00063970027D7A8E-0-0 |       63160 |                 1 |                             0 |                            1 |                                    0 |             153 |                   153 |                 1 |               24503 |                            0 |                          0 |               1 | -             | table_cnt=1,start_scn=1764208037339967000,end_scn=1764208338744161000; | 62133         | comment="cost_mb=3;"; |           0 |         0 |               | MACRO_BLOCK_LEVEL | EXEC_MODE_LOCAL |             0 |                      15 |              |                   |               |                 |         2114 |
| 00.00.000.233 |     2882 |      1016 |     1 |     49402 | MINI_MERGE | 1764208224322606000 | 2025-11-27 09:50:27.727891 | 2025-11-27 09:50:27.737605 | YB420B26ECE9-0006395FF23EED6E-0-0 |       52753 |                 1 |                             0 |                            1 |                                    0 |             150 |                   150 |                 1 |               20888 |                            0 |                          0 |               1 | -             | table_cnt=1,start_scn=1764207925542206000,end_scn=1764208224322606000; | 195120        | comment="cost_mb=3;"; |           0 |         0 |               | MACRO_BLOCK_LEVEL | EXEC_MODE_LOCAL |             0 |                      16 |              |                   |               |                 |         2055 |
| 00.00.000.234 |     2882 |      1016 |     1 |     49402 | MINI_MERGE | 1764208037339967000 | 2025-11-27 09:47:17.787445 | 2025-11-27 09:47:17.796466 | YB420B26ECEA-00063970027D7A8C-0-0 |       61832 |                 1 |                             0 |                            1 |                                    0 |             151 |                   151 |                 1 |               22545 |                            0 |                          0 |               1 | -             | table_cnt=1,start_scn=1764207734131662000,end_scn=1764208037339967000; | 143285        | comment="cost_mb=3;"; |           0 |         0 |               | MACRO_BLOCK_LEVEL | EXEC_MODE_LOCAL |             0 |                      14 |              |                   |               |                 |         2228 |
| 00.00.000.233 |     2882 |      1016 |     1 |     49402 | MINI_MERGE | 1764207925542206000 | 2025-11-27 09:45:25.735778 | 2025-11-27 09:45:25.743293 | YB420B26ECE9-0006395FF23EED6D-0-0 |       51655 |                 1 |                             0 |                            1 |                                    0 |             150 |                   150 |                 1 |               24837 |                            0 |                          0 |               1 | -             | table_cnt=1,start_scn=1764207622997391000,end_scn=1764207925542206000; | 195120        | comment="cost_mb=3;"; |           0 |         0 |               | MACRO_BLOCK_LEVEL | EXEC_MODE_LOCAL |             0 |                      19 |              |                   |               |                 |         1620 |
| 00.00.000.234 |     2882 |      1016 |     1 |     49402 | MINI_MERGE | 1764207734131662000 | 2025-11-27 09:42:17.783638 | 2025-11-27 09:42:17.792571 | YB420B26ECEA-00063970027D7A8B-0-0 |       56563 |                 1 |                             0 |                            1 |                                    0 |             108 |                   108 |                 1 |               22305 |                            0 |                          0 |               1 | -             | table_cnt=1,start_scn=1764207437618899000,end_scn=1764207734131662000; | 143285        | comment="cost_mb=3;"; |           0 |         0 |               | MACRO_BLOCK_LEVEL | EXEC_MODE_LOCAL |             0 |                      14 |              |                   |               |                 |         2041 |
| 00.00.000.233 |     2882 |      1016 |     1 |     49402 | MINI_MERGE | 1764207622997391000 | 2025-11-27 09:40:23.735062 | 2025-11-27 09:40:23.743306 | YB420B26ECE9-0006395FF23EED6B-0-0 |       47762 |                 1 |                             0 |                            1 |                                    0 |             121 |                   121 |                 1 |               20735 |                            0 |                          0 |               1 | -             | table_cnt=1,start_scn=1764207319085807000,end_scn=1764207622997391000; | 195120        | comment="cost_mb=3;"; |           0 |         0 |               | MACRO_BLOCK_LEVEL | EXEC_MODE_LOCAL |             0 |                      19 |              |                   |               |                 |         1794 |
+---------------+----------+-----------+-------+-----------+------------+---------------------+----------------------------+----------------------------+-----------------------------------+-------------+-------------------+-------------------------------+------------------------------+--------------------------------------+-----------------+-----------------------+-------------------+---------------------+------------------------------+----------------------------+-----------------+---------------+------------------------------------------------------------------------+---------------+-----------------------+-------------+-----------+---------------+-------------------+-----------------+---------------+-------------------------+--------------+-------------------+---------------+-----------------+--------------+

obclient(root@sys)[oceanbase]> select svr_ip, svr_port, count(1) from __all_virtual_tablet_meta_table where tenant_id = 1016 and compaction_scn < 1764148949240376000 group by svr_ip;
+---------------+----------+----------+
| svr_ip        | svr_port | count(1) |
+---------------+----------+----------+
| 00.00.000.232 |     2882 |      760 |
| 00.00.000.233 |     2882 |      750 |
| 00.00.000.234 |     2882 |      750 |
+---------------+----------+----------+
3 rows in set (0.016 sec)