合并操作显示超时,是否可以手动中止

【 使用环境 】生产环境
【 OB or 其他组件 】 OB
【 使用版本 】3.1.2
【问题描述】
5月6号我手动触发了OB的合并操作,一直卡在99%并提示超时,是否可以手动中止掉这个合并任务,然后再启动新的合并任务,如果可以,应该如何中止?

昨天回收了一些租户的资源,旨在将资源空出来给合并任务使用,但目前来看没有效果。

可以先看一下原因是什么,再判断是否可以中止。 首先找到没有合并到指定版本的partition

方法一,如果可以连上集群查询
假设当前要合并的目标版本是25,可以去meta表看data_version != 25的副本有哪些,以缩小排查范围。这里meta表指一组表,一般先看最后一级meta表(__all_meta_table/__all_virtual_meta_table)有没有data_version没推上去的副本,没有的话,找更上一级的meta表。meta表指__all_virtual_core_meta_table、__all_virtual_core_root_table、__all_root_table、__all_virtual_meta_table

方法二,如果不能查询
以 "not merged"关键词搜索RS所在机器上的最新的rootservice.log

  1. 判断该partition的合并任务是否在执行中
select * from __all_virtual_sys_task_status
  1. 可以通过该虚拟表拿到执行的trace,去对应机器上查询,判断是否卡住
  2. 如果该partition没有调度合并任务
select * from __all_virtual_table_mgr where table_id = xxx and partition_id = xxx;
select * from __all_virtual_freeze_info where data_version = xxx;
  1. 判断该partition的最新的转储sstable的snapshot_version有没有推过freeze_info点,如果没有推过freeze_info点,表示转储有问题
select * from __all_virtual_table_mgr where table_id = xxx and partition_id = xxx and svr_ip= "xxx" and svr_port = xxx and is_active = 0 and snapshot_version > (select frozen_timestamp from __all_virtual_freeze_info where frozen_version = xxx)

如果结果为空,表示SSTable还没有推过Major点,怀疑合并前的强制冻结失败了
如果结果有一个memtable,表示合并需要的数据还有一部分在冻结memtable中,需要转储,查看是否有转储Dag 或 转储失败报错
如果结果有sstable,则应该发起合并,查看是否有合并Dag 或 合并失败报错
如果没有任何有用信息,可以搜索最近一段时间的observer.log的ERROR日志来获取线索。

太难了

我这个集群ocp显示合并中的版本为1980,后台查询结果


MySQL [oceanbase]> SELECT data_version from __all_virtual_core_meta_table;
+--------------+
| data_version |
+--------------+
|         1980 |
|         1980 |
|         1980 |
+--------------+
3 rows in set (0.00 sec)


MySQL [oceanbase]> SELECT data_version from __all_virtual_core_root_table;
+--------------+
| data_version |
+--------------+
|         1980 |
|         1980 |
|         1980 |
+--------------+
3 rows in set (0.01 sec)

MySQL [oceanbase]> 

MySQL [oceanbase]> SELECT *  from __all_root_table where data_version!='1980' limit 10;
+----------------------------+----------------------------+-----------+------------------+--------------+---------------+----------+----------+---------+---------------+-------+------+---------------------------------------------------------------------------------------------------------------+-----------+-----------+--------------+---------------+--------------+-----------------+--------------------+--------------------+-------------+---------+--------------+---------------+-----------------------+------------+--------------------+--------+-----------+--------------------+------------------+------------------+
| gmt_create                 | gmt_modified               | tenant_id | table_id         | partition_id | svr_ip        | svr_port | sql_port | unit_id | partition_cnt | zone  | role | member_list                                                                                                   | row_count | data_size | data_version | data_checksum | row_checksum | column_checksum | is_original_leader | is_previous_leader | create_time | rebuild | replica_type | required_size | status                | is_restore | partition_checksum | quorum | fail_list | recovery_timestamp | memstore_percent | data_file_id     |
+----------------------------+----------------------------+-----------+------------------+--------------+---------------+----------+----------+---------+---------------+-------+------+---------------------------------------------------------------------------------------------------------------+-----------+-----------+--------------+---------------+--------------+-----------------+--------------------+--------------------+-------------+---------+--------------+---------------+-----------------------+------------+--------------------+--------+-----------+--------------------+------------------+------------------+
| 2023-02-14 15:09:30.513190 | 2023-05-20 17:58:55.641336 |      1002 | 1101710651031555 |            0 | 192.168.170.8 |     2882 |     2881 |    1005 |             0 | zone1 |    1 | 192.168.170.8:2882:1676358437279479,192.168.170.10:2882:1684576326664802,192.168.170.13:2882:1683206046095778 |         0 |         0 |         1979 |             0 |            0 |                 |                  0 |   1676768404827041 |           0 |       0 |            0 |             0 | REPLICA_STATUS_NORMAL |          0 |                  0 |      3 |           |                  0 |              100 | 1676358570517610 |
| 2023-02-14 15:09:30.744849 | 2023-05-20 17:58:55.916045 |      1002 | 1101710651031556 |            0 | 192.168.170.8 |     2882 |     2881 |    1005 |             0 | zone1 |    1 | 192.168.170.8:2882:1676358437279567,192.168.170.10:2882:1684576326664910,192.168.170.13:2882:1683206046095918 |       372 |     15383 |         1979 |    1202612866 |            0 |                 |                  0 |   1676768403826352 |           0 |       0 |            0 |       2097152 | REPLICA_STATUS_NORMAL |          0 |                  0 |      3 |           |                  0 |              100 | 1676358570517610 |
| 2023-02-14 15:09:31.007268 | 2023-05-20 17:58:56.174150 |      1002 | 1101710651031557 |            0 | 192.168.170.8 |     2882 |     2881 |    1005 |             0 | zone1 |    1 | 192.168.170.8:2882:1676358437279611,192.168.170.10:2882:1684576326664968,192.168.170.13:2882:1683206046101480 |       869 |    149116 |         1979 |    3406597430 |            0 |                 |                  0 |   1676768404819387 |           0 |       0 |            0 |       2097152 | REPLICA_STATUS_NORMAL |          0 |                  0 |      3 |           |                  0 |              100 | 1676358570517610 |
| 2023-02-14 15:09:31.256829 | 2023-05-20 17:58:56.430591 |      1002 | 1101710651031559 |            0 | 192.168.170.8 |     2882 |     2881 |    1005 |             0 | zone1 |    1 | 192.168.170.8:2882:1676358437279648,192.168.170.10:2882:1684576326667800,192.168.170.13:2882:1683206046104225 |        96 |     27413 |         1979 |     796518484 |            0 |                 |                  0 |   1676768403823046 |           0 |       0 |            0 |       2097152 | REPLICA_STATUS_NORMAL |          0 |                  0 |      3 |           |                  0 |              100 | 1676358570517610 |
| 2023-02-14 15:09:31.505085 | 2023-05-20 17:58:56.693574 |      1002 | 1101710651031654 |            0 | 192.168.170.8 |     2882 |     2881 |    1005 |             0 | zone1 |    1 | 192.168.170.8:2882:1676358437279680,192.168.170.10:2882:1684576326667860,192.168.170.13:2882:1683206046104312 |         7 |      2145 |         1979 |    3102305437 |            0 |                 |                  0 |   1676768404819590 |           0 |       0 |            0 |       2097152 | REPLICA_STATUS_NORMAL |          0 |                  0 |      3 |           |                  0 |              100 | 1676358570517610 |
| 2023-02-14 15:09:31.747383 | 2023-05-20 17:58:56.959745 |      1002 | 1101710651031655 |            0 | 192.168.170.8 |     2882 |     2881 |    1005 |             0 | zone1 |    1 | 192.168.170.8:2882:1676358437279713,192.168.170.10:2882:1684576326669602,192.168.170.13:2882:1683206046106783 |        19 |      2778 |         1979 |    2230937780 |            0 |                 |                  0 |   1676768403825699 |           0 |       0 |            0 |       2097152 | REPLICA_STATUS_NORMAL |          0 |                  0 |      3 |           |                  0 |              100 | 1676358570517610 |
| 2023-02-14 15:09:31.991255 | 2023-05-20 17:58:57.233880 |      1002 | 1101710651031656 |            0 | 192.168.170.8 |     2882 |     2881 |    1005 |             0 | zone1 |    1 | 192.168.170.8:2882:1676358437279746,192.168.170.10:2882:1684576326669655,192.168.170.13:2882:1683206046106868 |        14 |      1302 |         1979 |    2829170054 |            0 |                 |                  0 |   1676768403825243 |           0 |       0 |            0 |       2097152 | REPLICA_STATUS_NORMAL |          0 |                  0 |      3 |           |                  0 |              100 | 1676358570517610 |
| 2023-02-14 15:09:32.234354 | 2023-05-20 17:58:57.487769 |      1002 | 1101710651031657 |            0 | 192.168.170.8 |     2882 |     2881 |    1005 |             0 | zone1 |    1 | 192.168.170.8:2882:1676358437279783,192.168.170.10:2882:1684576326671274,192.168.170.13:2882:1683206046109261 |        14 |      1480 |         1979 |    1913692776 |            0 |                 |                  0 |   1676768404823396 |           0 |       0 |            0 |       2097152 | REPLICA_STATUS_NORMAL |          0 |                  0 |      3 |           |                  0 |              100 | 1676358570517610 |
| 2023-02-14 15:09:32.498946 | 2023-05-20 17:58:57.484643 |      1002 | 1101710651031658 |            0 | 192.168.170.8 |     2882 |     2881 |    1005 |             0 | zone1 |    1 | 192.168.170.8:2882:1676358437279819,192.168.170.10:2882:1684576326671330,192.168.170.13:2882:1683206046109345 |         1 |      1403 |         1979 |    2615241372 |            0 |                 |                  0 |   1676768404815210 |           0 |       0 |            0 |       2097152 | REPLICA_STATUS_NORMAL |          0 |                  0 |      3 |           |                  0 |              100 | 1676358570517610 |
| 2023-02-14 15:09:32.543112 | 2023-05-20 17:58:57.734230 |      1002 | 1101710651031659 |            0 | 192.168.170.8 |     2882 |     2881 |    1005 |             0 | zone1 |    1 | 192.168.170.8:2882:1676358437279864,192.168.170.10:2882:1684576326672934,192.168.170.13:2882:1683206046111682 |         1 |      1459 |         1979 |      24085749 |            0 |                 |                  0 |   1676768404821077 |           0 |       0 |            0 |       2097152 | REPLICA_STATUS_NORMAL |          0 |                  0 |      3 |           |                  0 |              100 | 1676358570517610 |
+----------------------------+----------------------------+-----------+------------------+--------------+---------------+----------+----------+---------+---------------+-------+------+---------------------------------------------------------------------------------------------------------------+-----------+-----------+--------------+---------------+--------------+-----------------+--------------------+--------------------+-------------+---------+--------------+---------------+-----------------------+------------+--------------------+--------+-----------+--------------------+------------------+------------------+
10 rows in set (0.02 sec)

__all_virtual_meta_table,没有看到有这个表

MySQL [oceanbase]> SELECT *  from __all_virtual_meta_table;
ERROR 4013 (HY001): No memory or reach tenant memory limit
MySQL [oceanbase]> 

__all_virtual_sys_task_status表查询为空

MySQL [oceanbase]> select * from __all_virtual_sys_task_status;
Empty set (0.00 sec)

另外,我在20号的时候重启了一个observe,发现那个zone上的合并自己结束了

查询select * from __all_virtual_freeze_info where data_version = 1008;
select * from __all_virtual_table_mgr where table_id = 1101710651031555 and partition_id = 0;看看

您帮忙看看呢

MySQL [oceanbase]> select * from __all_virtual_freeze_info
    -> ;
+----------------+------------------+----------------+
| frozen_version | frozen_timestamp | schema_version |
+----------------+------------------+----------------+
|           1948 | 1681236010796215 |           NULL |
|           1949 | 1681322410757733 |           NULL |
|           1950 | 1681408810671285 |           NULL |
|           1951 | 1681495210636844 |           NULL |
|           1952 | 1681581610406025 |           NULL |
|           1953 | 1681668010215764 |           NULL |
|           1954 | 1681754410149450 |           NULL |
|           1955 | 1681840810138037 |           NULL |
|           1956 | 1681927210121007 |           NULL |
|           1957 | 1682013610959842 |           NULL |
|           1958 | 1682100010085876 |           NULL |
|           1959 | 1682186410871720 |           NULL |
|           1960 | 1682272810679048 |           NULL |
|           1961 | 1682359210596952 |           NULL |
|           1962 | 1682445610485412 |           NULL |
|           1963 | 1682532010332716 |           NULL |
|           1964 | 1682584843729753 |           NULL |
|           1965 | 1682589246538945 |           NULL |
|           1966 | 1682591427255637 |           NULL |
|           1967 | 1682594819997663 |           NULL |
|           1968 | 1682596510310619 |           NULL |
|           1969 | 1682618410225458 |           NULL |
|           1970 | 1682648582332828 |           NULL |
|           1971 | 1682704810092299 |           NULL |
|           1972 | 1682791210843097 |           NULL |
|           1973 | 1682877610640717 |           NULL |
|           1974 | 1682964010398822 |           NULL |
|           1975 | 1683050410158639 |           NULL |
|           1976 | 1683136810899871 |           NULL |
|           1977 | 1683209362870687 |           NULL |
|           1978 | 1683223210753935 |           NULL |
|           1979 | 1683309610731477 |           NULL |
|           1980 | 1683351243287689 |           NULL |
+----------------+------------------+----------------+
33 rows in set (0.01 sec)


MySQL [oceanbase]> select * from __all_virtual_table_mgr where table_id = 1101710651031555 and partition_id = 0 limit 20;
+---------------+----------+-----------+------------+------------------+--------------+------------------+------------------+---------------------+---------------------+--------------------+---------------------+------------------+---------------------+------------------+---------+----------------------+------+-------------+-----------+------------------+-----+-----------+-----------+--------------------------------+-------------------------+
| svr_ip        | svr_port | tenant_id | table_type | table_id         | partition_id | index_id         | base_version     | multi_version_start | snapshot_version    | max_merged_version | upper_trans_version | start_log_ts     | end_log_ts          | max_log_ts       | version | logical_data_version | size | compact_row | is_active | timestamp        | ref | write_ref | trx_count | pending_log_persisting_row_cnt | contain_uncommitted_row |
+---------------+----------+-----------+------------+------------------+--------------+------------------+------------------+---------------------+---------------------+--------------------+---------------------+------------------+---------------------+------------------+---------+----------------------+------+-------------+-----------+------------------+-----+-----------+-----------+--------------------------------+-------------------------+
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683351235286646 |    1683351235286646 |    1683362204481579 |                  0 |    1683362204481579 | 1683351235286646 |    1683362204481579 | 1683362204481579 |       0 |                    0 |    0 |           0 |         0 | 1683351235342296 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683482923678203 |    1683482923678203 |    1683486527999533 |                  0 |    1683486527999533 | 1683482923678203 |    1683486527999533 | 1683486527999533 |       0 |                    0 |    0 |           0 |         0 | 1683482923732670 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683310343267158 |    1683310343267158 |    1683351235286646 |                  0 |    1683351235286646 | 1683310343267158 |    1683351235286646 | 1683351235286646 |       0 |                    0 |    0 |           0 |         0 | 1683310343298702 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683453712028435 |    1683453712028435 |    1683479724909735 |                  0 |    1683479724909735 | 1683453712028435 |    1683479724909735 | 1683479724909735 |       0 |                    0 |    0 |           0 |         0 | 1683453712040051 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683486527999533 |    1683486527999533 | 9223372036854775807 |                  0 | 9223372036854775807 | 1683486527999533 | 9223372036854775807 |                0 |       0 |                    0 |    0 |           0 |         1 | 1683486528096585 |   2 |         0 |         0 |            9223372036854775807 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683362204481579 |    1683362204481579 |    1683453712028435 |                  0 |    1683453712028435 | 1683362204481579 |    1683453712028435 | 1683453712028435 |       0 |                    0 |    0 |           0 |         0 | 1683362204499785 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683479724909735 |    1683479724909735 |    1683482923678203 |                  0 |    1683482923678203 | 1683479724909735 |    1683482923678203 | 1683482923678203 |       0 |                    0 |    0 |           0 |         0 | 1683479724958693 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1679921398106716 |    1679921398106716 |   1679921398106716 |    1679921398106716 |                0 |                   0 |                0 |    1925 |                 1925 |    0 |           1 |         0 |                0 |   3 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1679940010221907 |    1679940010221907 |   1679940010221907 |    1679940010221907 |                0 |                   0 |                0 |    1926 |                 1926 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680026410166309 |    1680026410166309 |   1680026410166309 |    1680026410166309 |                0 |                   0 |                0 |    1927 |                 1927 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680087444176667 |    1680087444176667 |   1680087444176667 |    1680087444176667 |                0 |                   0 |                0 |    1928 |                 1928 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680112810368426 |    1680112810368426 |   1680112810368426 |    1680112810368426 |                0 |                   0 |                0 |    1929 |                 1929 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680158433408908 |    1680158433408908 |   1680158433408908 |    1680158433408908 |                0 |                   0 |                0 |    1930 |                 1930 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680178721972075 |    1680178721972075 |   1680178721972075 |    1680178721972075 |                0 |                   0 |                0 |    1931 |                 1931 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680199210985628 |    1680199210985628 |   1680199210985628 |    1680199210985628 |                0 |                   0 |                0 |    1932 |                 1932 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680263639746976 |    1680263639746976 |   1680263639746976 |    1680263639746976 |                0 |                   0 |                0 |    1933 |                 1933 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680285610658617 |    1680285610658617 |   1680285610658617 |    1680285610658617 |                0 |                   0 |                0 |    1934 |                 1934 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680372010336769 |    1680372010336769 |   1680372010336769 |    1680372010336769 |                0 |                   0 |                0 |    1935 |                 1935 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680458410092390 |    1680458410092390 |   1680458410092390 |    1680458410092390 |                0 |                   0 |                0 |    1936 |                 1936 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680544810025770 |    1680544810025770 |   1680544810025770 |    1680544810025770 |                0 |                   0 |                0 |    1937 |                 1937 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
+---------------+----------+-----------+------------+------------------+--------------+------------------+------------------+---------------------+---------------------+--------------------+---------------------+------------------+---------------------+------------------+---------+----------------------+------+-------------+-----------+------------------+-----+-----------+-----------+--------------------------------+-------------------------+
20 rows in set (0.57 sec)

到192.168.170.8 | 2882 机器上查一下日志看看
grep “WARN” observer.log.* observer.log | grep “dag” |
如果日志太多的话,grep 5月20号和今天的看看


貌似没有相关的日志

那把warn日志传一下吧。
select * from __all_virtual_table_mgr where table_id = 1101710651031555 and partition_id = 0 and snapshot_version > 1683351243287689的结果全部输出看一下。
看起来像是转储失败了。

Database changed
MySQL [oceanbase]> select * from __all_virtual_table_mgr where table_id = 1101710651031555 and partition_id = 0 and snapshot_version > 1683351243287689
    -> ;
+----------------+----------+-----------+------------+------------------+--------------+------------------+------------------+---------------------+---------------------+--------------------+---------------------+------------------+---------------------+------------------+---------+----------------------+------+-------------+-----------+------------------+-----+-----------+-----------+--------------------------------+-------------------------+
| svr_ip         | svr_port | tenant_id | table_type | table_id         | partition_id | index_id         | base_version     | multi_version_start | snapshot_version    | max_merged_version | upper_trans_version | start_log_ts     | end_log_ts          | max_log_ts       | version | logical_data_version | size | compact_row | is_active | timestamp        | ref | write_ref | trx_count | pending_log_persisting_row_cnt | contain_uncommitted_row |
+----------------+----------+-----------+------------+------------------+--------------+------------------+------------------+---------------------+---------------------+--------------------+---------------------+------------------+---------------------+------------------+---------+----------------------+------+-------------+-----------+------------------+-----+-----------+-----------+--------------------------------+-------------------------+
| 192.168.170.10 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683478032843515 |    1683478032843515 | 9223372036854775807 |                  0 | 9223372036854775807 | 1683478032843515 | 9223372036854775807 |                0 |       0 |                    0 |    0 |           0 |         1 | 1684587324319079 |   2 |         0 |         0 |            9223372036854775807 |                       1 |
| 192.168.170.10 |     2882 |      1002 |          7 | 1101710651031555 |            0 | 1101710651031555 | 1683351235286646 |    1683351243287689 |    1683373111437795 |   1683373111437795 |    1683373111437795 | 1683351235286646 |    1683373111437795 | 1683373111437795 |       0 |     1683373111437795 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.10 |     2882 |      1002 |          7 | 1101710651031555 |            0 | 1101710651031555 | 1683373111437795 |    1683478032843515 |    1683478032843515 |   1683478032843515 |    1683478032843515 | 1683373111437795 |    1683478032843515 | 1683478032843515 |       0 |     1683478032843515 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.13 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683478032843515 |    1683478032843515 | 9223372036854775807 |                  0 | 9223372036854775807 | 1683478032843515 | 9223372036854775807 |                0 |       0 |                    0 |    0 |           0 |         1 | 1683478032928368 |   2 |         0 |         0 |            9223372036854775807 |                       1 |
| 192.168.170.13 |     2882 |      1002 |          7 | 1101710651031555 |            0 | 1101710651031555 | 1683351235286646 |    1683351243287689 |    1683373111437795 |   1683373111437795 |    1683373111437795 | 1683351235286646 |    1683373111437795 | 1683373111437795 |       0 |     1683373111437795 |    0 |           1 |         0 | 1683351235354468 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.13 |     2882 |      1002 |          7 | 1101710651031555 |            0 | 1101710651031555 | 1683373111437795 |    1683478032843515 |    1683478032843515 |   1683478032843515 |    1683478032843515 | 1683373111437795 |    1683478032843515 | 1683478032843515 |       0 |     1683478032843515 |    0 |           1 |         0 | 1683373111465337 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.13 |     2882 |      1002 |          5 | 1101710651031555 |            0 | 1101710651031555 | 1683373111437795 |    1683478032843515 |    1683478032843515 |   1683478032843515 |    1683478032843515 | 1683373111437795 |    1683478032843515 | 1683478032843515 |       0 |     1683478032843515 |    0 |           1 |         0 | 1683373111465337 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8  |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683351235286646 |    1683351235286646 |    1683362204481579 |                  0 |    1683362204481579 | 1683351235286646 |    1683362204481579 | 1683362204481579 |       0 |                    0 |    0 |           0 |         0 | 1683351235342296 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8  |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683482923678203 |    1683482923678203 |    1683486527999533 |                  0 |    1683486527999533 | 1683482923678203 |    1683486527999533 | 1683486527999533 |       0 |                    0 |    0 |           0 |         0 | 1683482923732670 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8  |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683453712028435 |    1683453712028435 |    1683479724909735 |                  0 |    1683479724909735 | 1683453712028435 |    1683479724909735 | 1683479724909735 |       0 |                    0 |    0 |           0 |         0 | 1683453712040051 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8  |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683486527999533 |    1683486527999533 | 9223372036854775807 |                  0 | 9223372036854775807 | 1683486527999533 | 9223372036854775807 |                0 |       0 |                    0 |    0 |           0 |         1 | 1683486528096585 |   2 |         0 |         0 |            9223372036854775807 |                       1 |
| 192.168.170.8  |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683362204481579 |    1683362204481579 |    1683453712028435 |                  0 |    1683453712028435 | 1683362204481579 |    1683453712028435 | 1683453712028435 |       0 |                    0 |    0 |           0 |         0 | 1683362204499785 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8  |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683479724909735 |    1683479724909735 |    1683482923678203 |                  0 |    1683482923678203 | 1683479724909735 |    1683482923678203 | 1683482923678203 |       0 |                    0 |    0 |           0 |         0 | 1683479724958693 |   2 |         0 |         0 |                              0 |                       1 |
+----------------+----------+-----------+------------+------------------+--------------+------------------+------------------+---------------------+---------------------+--------------------+---------------------+------------------+---------------------+------------------+---------+----------------------+------+-------------+-----------+------------------+-----+-----------+-----------+--------------------------------+-------------------------+
13 rows in set (2.81 sec)

MySQL [oceanbase]> 

observer.log.wf.tar.gz (2.2 KB)

observer.log.wf.20230524170738.tar.gz (6.2 MB)

查下select * from __all_virtual_tenant_memstore_info where tenant_id = 1002;
select * from __all_virtual_table_mgr where table_id = 1101710651031555 and partition_id = 0 and svr_ip = “192.168.170.8”;


MySQL [oceanbase]> select * from __all_virtual_table_mgr where table_id = 1101710651031555 and partition_id = 0 and svr_ip = "192.168.170.8";
+---------------+----------+-----------+------------+------------------+--------------+------------------+------------------+---------------------+---------------------+--------------------+---------------------+------------------+---------------------+------------------+---------+----------------------+------+-------------+-----------+------------------+-----+-----------+-----------+--------------------------------+-------------------------+
| svr_ip        | svr_port | tenant_id | table_type | table_id         | partition_id | index_id         | base_version     | multi_version_start | snapshot_version    | max_merged_version | upper_trans_version | start_log_ts     | end_log_ts          | max_log_ts       | version | logical_data_version | size | compact_row | is_active | timestamp        | ref | write_ref | trx_count | pending_log_persisting_row_cnt | contain_uncommitted_row |
+---------------+----------+-----------+------------+------------------+--------------+------------------+------------------+---------------------+---------------------+--------------------+---------------------+------------------+---------------------+------------------+---------+----------------------+------+-------------+-----------+------------------+-----+-----------+-----------+--------------------------------+-------------------------+
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683351235286646 |    1683351235286646 |    1683362204481579 |                  0 |    1683362204481579 | 1683351235286646 |    1683362204481579 | 1683362204481579 |       0 |                    0 |    0 |           0 |         0 | 1683351235342296 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683482923678203 |    1683482923678203 |    1683486527999533 |                  0 |    1683486527999533 | 1683482923678203 |    1683486527999533 | 1683486527999533 |       0 |                    0 |    0 |           0 |         0 | 1683482923732670 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683310343267158 |    1683310343267158 |    1683351235286646 |                  0 |    1683351235286646 | 1683310343267158 |    1683351235286646 | 1683351235286646 |       0 |                    0 |    0 |           0 |         0 | 1683310343298702 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683453712028435 |    1683453712028435 |    1683479724909735 |                  0 |    1683479724909735 | 1683453712028435 |    1683479724909735 | 1683479724909735 |       0 |                    0 |    0 |           0 |         0 | 1683453712040051 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683486527999533 |    1683486527999533 | 9223372036854775807 |                  0 | 9223372036854775807 | 1683486527999533 | 9223372036854775807 |                0 |       0 |                    0 |    0 |           0 |         1 | 1683486528096585 |   2 |         0 |         0 |            9223372036854775807 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683362204481579 |    1683362204481579 |    1683453712028435 |                  0 |    1683453712028435 | 1683362204481579 |    1683453712028435 | 1683453712028435 |       0 |                    0 |    0 |           0 |         0 | 1683362204499785 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          0 | 1101710651031555 |            0 | 1101710651031555 | 1683479724909735 |    1683479724909735 |    1683482923678203 |                  0 |    1683482923678203 | 1683479724909735 |    1683482923678203 | 1683482923678203 |       0 |                    0 |    0 |           0 |         0 | 1683479724958693 |   2 |         0 |         0 |                              0 |                       1 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1679921398106716 |    1679921398106716 |   1679921398106716 |    1679921398106716 |                0 |                   0 |                0 |    1925 |                 1925 |    0 |           1 |         0 |                0 |   3 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1679940010221907 |    1679940010221907 |   1679940010221907 |    1679940010221907 |                0 |                   0 |                0 |    1926 |                 1926 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680026410166309 |    1680026410166309 |   1680026410166309 |    1680026410166309 |                0 |                   0 |                0 |    1927 |                 1927 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680087444176667 |    1680087444176667 |   1680087444176667 |    1680087444176667 |                0 |                   0 |                0 |    1928 |                 1928 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680112810368426 |    1680112810368426 |   1680112810368426 |    1680112810368426 |                0 |                   0 |                0 |    1929 |                 1929 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680158433408908 |    1680158433408908 |   1680158433408908 |    1680158433408908 |                0 |                   0 |                0 |    1930 |                 1930 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680178721972075 |    1680178721972075 |   1680178721972075 |    1680178721972075 |                0 |                   0 |                0 |    1931 |                 1931 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680199210985628 |    1680199210985628 |   1680199210985628 |    1680199210985628 |                0 |                   0 |                0 |    1932 |                 1932 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680263639746976 |    1680263639746976 |   1680263639746976 |    1680263639746976 |                0 |                   0 |                0 |    1933 |                 1933 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680285610658617 |    1680285610658617 |   1680285610658617 |    1680285610658617 |                0 |                   0 |                0 |    1934 |                 1934 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680372010336769 |    1680372010336769 |   1680372010336769 |    1680372010336769 |                0 |                   0 |                0 |    1935 |                 1935 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680458410092390 |    1680458410092390 |   1680458410092390 |    1680458410092390 |                0 |                   0 |                0 |    1936 |                 1936 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680544810025770 |    1680544810025770 |   1680544810025770 |    1680544810025770 |                0 |                   0 |                0 |    1937 |                 1937 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680631210974726 |    1680631210974726 |   1680631210974726 |    1680631210974726 |                0 |                   0 |                0 |    1938 |                 1938 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680660974416348 |    1680660974416348 |   1680660974416348 |    1680660974416348 |                0 |                   0 |                0 |    1939 |                 1939 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680682425950785 |    1680682425950785 |   1680682425950785 |    1680682425950785 |                0 |                   0 |                0 |    1940 |                 1940 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680717610664182 |    1680717610664182 |   1680717610664182 |    1680717610664182 |                0 |                   0 |                0 |    1941 |                 1941 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680804010522342 |    1680804010522342 |   1680804010522342 |    1680804010522342 |                0 |                   0 |                0 |    1942 |                 1942 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680890410421492 |    1680890410421492 |   1680890410421492 |    1680890410421492 |                0 |                   0 |                0 |    1943 |                 1943 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1680976810172292 |    1680976810172292 |   1680976810172292 |    1680976810172292 |                0 |                   0 |                0 |    1944 |                 1944 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681048189566147 |    1681048189566147 |   1681048189566147 |    1681048189566147 |                0 |                   0 |                0 |    1945 |                 1945 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681063210986783 |    1681063210986783 |   1681063210986783 |    1681063210986783 |                0 |                   0 |                0 |    1946 |                 1946 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681149610887095 |    1681149610887095 |   1681149610887095 |    1681149610887095 |                0 |                   0 |                0 |    1947 |                 1947 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681236010796215 |    1681236010796215 |   1681236010796215 |    1681236010796215 |                0 |                   0 |                0 |    1948 |                 1948 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681322410757733 |    1681322410757733 |   1681322410757733 |    1681322410757733 |                0 |                   0 |                0 |    1949 |                 1949 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681408810671285 |    1681408810671285 |   1681408810671285 |    1681408810671285 |                0 |                   0 |                0 |    1950 |                 1950 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681495210636844 |    1681495210636844 |   1681495210636844 |    1681495210636844 |                0 |                   0 |                0 |    1951 |                 1951 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681581610406025 |    1681581610406025 |   1681581610406025 |    1681581610406025 |                0 |                   0 |                0 |    1952 |                 1952 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681668010215764 |    1681668010215764 |   1681668010215764 |    1681668010215764 |                0 |                   0 |                0 |    1953 |                 1953 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681754410149450 |    1681754410149450 |   1681754410149450 |    1681754410149450 |                0 |                   0 |                0 |    1954 |                 1954 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681840810138037 |    1681840810138037 |   1681840810138037 |    1681840810138037 |                0 |                   0 |                0 |    1955 |                 1955 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1681927210121007 |    1681927210121007 |   1681927210121007 |    1681927210121007 |                0 |                   0 |                0 |    1956 |                 1956 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682013610959842 |    1682013610959842 |   1682013610959842 |    1682013610959842 |                0 |                   0 |                0 |    1957 |                 1957 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682100010085876 |    1682100010085876 |   1682100010085876 |    1682100010085876 |                0 |                   0 |                0 |    1958 |                 1958 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682186410871720 |    1682186410871720 |   1682186410871720 |    1682186410871720 |                0 |                   0 |                0 |    1959 |                 1959 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682272810679048 |    1682272810679048 |   1682272810679048 |    1682272810679048 |                0 |                   0 |                0 |    1960 |                 1960 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682359210596952 |    1682359210596952 |   1682359210596952 |    1682359210596952 |                0 |                   0 |                0 |    1961 |                 1961 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682445610485412 |    1682445610485412 |   1682445610485412 |    1682445610485412 |                0 |                   0 |                0 |    1962 |                 1962 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682532010332716 |    1682532010332716 |   1682532010332716 |    1682532010332716 |                0 |                   0 |                0 |    1963 |                 1963 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682584843729753 |    1682584843729753 |   1682584843729753 |    1682584843729753 |                0 |                   0 |                0 |    1964 |                 1964 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682589246538945 |    1682589246538945 |   1682589246538945 |    1682589246538945 |                0 |                   0 |                0 |    1965 |                 1965 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682591427255637 |    1682591427255637 |   1682591427255637 |    1682591427255637 |                0 |                   0 |                0 |    1966 |                 1966 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682594819997663 |    1682594819997663 |   1682594819997663 |    1682594819997663 |                0 |                   0 |                0 |    1967 |                 1967 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682596510310619 |    1682596510310619 |   1682596510310619 |    1682596510310619 |                0 |                   0 |                0 |    1968 |                 1968 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682618410225458 |    1682618410225458 |   1682618410225458 |    1682618410225458 |                0 |                   0 |                0 |    1969 |                 1969 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682648582332828 |    1682648582332828 |   1682648582332828 |    1682648582332828 |                0 |                   0 |                0 |    1970 |                 1970 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682704810092299 |    1682704810092299 |   1682704810092299 |    1682704810092299 |                0 |                   0 |                0 |    1971 |                 1971 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682791210843097 |    1682791210843097 |   1682791210843097 |    1682791210843097 |                0 |                   0 |                0 |    1972 |                 1972 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682877610640717 |    1682877610640717 |   1682877610640717 |    1682877610640717 |                0 |                   0 |                0 |    1973 |                 1973 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1682964010398822 |    1682964010398822 |   1682964010398822 |    1682964010398822 |                0 |                   0 |                0 |    1974 |                 1974 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1683050410158639 |    1683050410158639 |   1683050410158639 |    1683050410158639 |                0 |                   0 |                0 |    1975 |                 1975 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1683136810899871 |    1683136810899871 |   1683136810899871 |    1683136810899871 |                0 |                   0 |                0 |    1976 |                 1976 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1683209362870687 |    1683209362870687 |   1683209362870687 |    1683209362870687 |                0 |                   0 |                0 |    1977 |                 1977 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1683223210753935 |    1683223210753935 |   1683223210753935 |    1683223210753935 |                0 |                   0 |                0 |    1978 |                 1978 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          1 | 1101710651031555 |            0 | 1101710651031555 |                0 |    1683309610731477 |    1683309610731477 |   1683309610731477 |    1683309610731477 |                0 |                   0 |                0 |    1979 |                 1979 |    0 |           1 |         0 |                0 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          7 | 1101710651031555 |            0 | 1101710651031555 | 1679918273436838 |    1679940004996855 |    1683309602769367 |   1683309602769367 |    1683309602769367 | 1679918273436838 |    1683309602769367 | 1683309602769367 |       0 |     1683309602769367 |    0 |           1 |         0 | 1683223900540881 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          7 | 1101710651031555 |            0 | 1101710651031555 | 1683309602769367 |    1683309602769367 |    1683310343267158 |   1683310343267158 |    1683310343267158 | 1683309602769367 |    1683310343267158 | 1683310343267158 |       0 |     1683310343267158 |    0 |           1 |         0 | 1683309602784212 |   2 |         0 |         0 |                              0 |                       0 |
| 192.168.170.8 |     2882 |      1002 |          5 | 1101710651031555 |            0 | 1101710651031555 | 1683309602769367 |    1683309602769367 |    1683310343267158 |   1683310343267158 |    1683310343267158 | 1683309602769367 |    1683310343267158 | 1683310343267158 |       0 |     1683310343267158 |    0 |           1 |         0 | 1683309602784212 |   2 |         0 |         0 |                              0 |                       0 |
+---------------+----------+-----------+------------+------------------+--------------+------------------+------------------+---------------------+---------------------+--------------------+---------------------+------------------+---------------------+------------------+---------+----------------------+------+-------------+-----------+------------------+-----+-----------+-----------+--------------------------------+-------------------------+
65 rows in set (1.06 sec)

MySQL [oceanbase]> 

在192.168.170.8 机器的observer.log.*里找一下grep “try minor merge all” | grep “T1002” (确认一下转储调度线程在跑
以及 grep “schedule merge sstable dag finish.*pkey” | grep “T1002”(确认一下调度了转储任务没

是要找1002这个租户吗?

是的

稍等一下啊,刚grep ‘T1002’ 貌似啥也没找到

话说ocp上一直有这些告警