【 使用环境 】生产环境
【 OB or 其他组件 】4.3.5.2
【 使用版本 】
【问题描述】
最近5天,每天都在报转储卡合并,但是实际tablet又正常合并成功了。。6个节点每个节点都在报,不同的tablet id。这是其中一个节点的报错
[OBServer 转储卡合并] 集群:xxxx,主机:xxx.xx.xx.25,日志类型:observer,日志文件:/home/apps/oceanbase/log/observer.log,日志级别:INFO,关键字=[STORAGE.COMPACTION].*ret=-4019,错误码=-1,日志详情=[2026-02-18 09:56:08.881540] INFO [STORAGE.COMPACTION] schedule_merge_dag (ob_tenant_tablet_scheduler.cpp:1068) [3820466][T1002_TimerWK3_MediumLoop][T1002][YB420A8C0619-000649F42B4F80D7-0-0] [lt=25] schedule merge dag(ret=-4019, param={skip_get_tablet:false, merge_type:“MEDIUM_MERGE”, merge_version:1771378775520306000, ls_id:{id:1001}, tablet_id:{id:1152921504606950566}, exec_mode:“EXEC_MODE_LOCAL”, need_swap_tablet_flag:false, is_reserve_mode:false, schedule_transfer_seq:0}, tablet.is_row_store()=true, merge_type=6, co_major_merge_type=0, cs_replica_status=0)。
select * from GV$OB_TABLET_COMPACTION_HISTORY where tablet_id=1152921504606950566 order by start_time desc limit 10\G;
mysql> select * from GV$OB_TABLET_COMPACTION_HISTORY where tablet_id=1152921504606950566 order by start_time desc limit 10\G;
*************************** 1. row ***************************
SVR_IP: xxx.27
SVR_PORT: 2882
TENANT_ID: 1002
LS_ID: 1001
TABLET_ID: 1152921504606950566
TYPE: MDS_MINOR_MERGE
COMPACTION_SCN: 1771403044208943001
START_TIME: 2026-02-18 16:24:18.647675
FINISH_TIME: 2026-02-18 16:24:18.653136
TASK_ID: YB420A8CA71B-00064AC29DEC21E3-0-0
OCCUPY_SIZE: 494
MACRO_BLOCK_COUNT: 1
MULTIPLEXED_MACRO_BLOCK_COUNT: 0
NEW_MICRO_COUNT_IN_NEW_MACRO: 1
MULTIPLEXED_MICRO_COUNT_IN_NEW_MACRO: 0
TOTAL_ROW_COUNT: 1
INCREMENTAL_ROW_COUNT: 1
COMPRESSION_RATIO: 1
NEW_FLUSH_DATA_RATE: 93
PROGRESSIVE_COMPACTION_ROUND: 0
PROGRESSIVE_COMPACTION_NUM: 0
PARALLEL_DEGREE: 1
PARALLEL_INFO: -
PARTICIPANT_TABLE: table_cnt=2,start_scn=1,end_scn=1771403044208943001;
MACRO_ID_LIST: 4204031
COMMENTS: comment=“cost_mb=2;”;
START_CG_ID: 0
END_CG_ID: 0
KEPT_SNAPSHOT:
MERGE_LEVEL: MACRO_BLOCK_LEVEL
EXEC_MODE: EXEC_MODE_LOCAL
IS_FULL_MERGE: FALSE
IO_COST_TIME_PERCENTAGE: 4
MERGE_REASON:
BASE_MAJOR_STATUS:
CO_MERGE_TYPE:
MDS_FILTER_INFO:
*************************** 2. row ***************************
SVR_IP: xxx.xx.xx.25
SVR_PORT: 2882
TENANT_ID: 1002
LS_ID: 1001
TABLET_ID: 1152921504606950566
TYPE: MAJOR_MERGE
COMPACTION_SCN: 1771378775520306000
START_TIME: 2026-02-18 10:52:12.377907
FINISH_TIME: 2026-02-18 10:52:12.400435
TASK_ID: YB420A8C0619-000649F5130EE7B8-0-0
OCCUPY_SIZE: 0
MACRO_BLOCK_COUNT: 0
MULTIPLEXED_MACRO_BLOCK_COUNT: 0
NEW_MICRO_COUNT_IN_NEW_MACRO: 0
MULTIPLEXED_MICRO_COUNT_IN_NEW_MACRO: 0
TOTAL_ROW_COUNT: 0
INCREMENTAL_ROW_COUNT: 0
COMPRESSION_RATIO: 1
NEW_FLUSH_DATA_RATE: 0
PROGRESSIVE_COMPACTION_ROUND: 1
PROGRESSIVE_COMPACTION_NUM: 0
PARALLEL_DEGREE: 1
PARALLEL_INFO: -
PARTICIPANT_TABLE: table_cnt=1,[MAJOR]snapshot_version=1771351201207505001;
MACRO_ID_LIST:
COMMENTS: comment=“time=add_time:1771379911443158|wait_schedule_time=3220.93s;”;
START_CG_ID: 0
END_CG_ID: 0
KEPT_SNAPSHOT: {type:“MAJOR_FREEZE_TS”, snapshot:1771378775520306000}
MERGE_LEVEL: MICRO_BLOCK_LEVEL
EXEC_MODE: EXEC_MODE_LOCAL
IS_FULL_MERGE: FALSE
IO_COST_TIME_PERCENTAGE: 0
MERGE_REASON: TENANT_MAJOR
BASE_MAJOR_STATUS:
CO_MERGE_TYPE:
MDS_FILTER_INFO:
*************************** 3. row ***************************
SVR_IP:xxx.27
SVR_PORT: 2882
TENANT_ID: 1002
LS_ID: 1001
TABLET_ID: 1152921504606950566
TYPE: MAJOR_MERGE
COMPACTION_SCN: 1771378775520306000
START_TIME: 2026-02-18 10:43:55.011907
FINISH_TIME: 2026-02-18 10:43:55.019099
TASK_ID: YB420A8CA71B-00064AC29DEBECF8-0-0
OCCUPY_SIZE: 0
MACRO_BLOCK_COUNT: 0
MULTIPLEXED_MACRO_BLOCK_COUNT: 0
NEW_MICRO_COUNT_IN_NEW_MACRO: 0
MULTIPLEXED_MICRO_COUNT_IN_NEW_MACRO: 0
TOTAL_ROW_COUNT: 0
INCREMENTAL_ROW_COUNT: 0
COMPRESSION_RATIO: 1
NEW_FLUSH_DATA_RATE: 0
PROGRESSIVE_COMPACTION_ROUND: 1
PROGRESSIVE_COMPACTION_NUM: 0
PARALLEL_DEGREE: 1
PARALLEL_INFO: -
PARTICIPANT_TABLE: table_cnt=1,[MAJOR]snapshot_version=1771351201207505001;
MACRO_ID_LIST:
COMMENTS: comment=“time=add_time:1771379537305245|wait_schedule_time=3097.71s;”;
START_CG_ID: 0
END_CG_ID: 0
KEPT_SNAPSHOT: {type:“MAJOR_FREEZE_TS”, snapshot:1771378775520306000}
MERGE_LEVEL: MICRO_BLOCK_LEVEL
EXEC_MODE: EXEC_MODE_LOCAL
IS_FULL_MERGE: FALSE
IO_COST_TIME_PERCENTAGE: 0
MERGE_REASON: TENANT_MAJOR
BASE_MAJOR_STATUS:
CO_MERGE_TYPE:
MDS_FILTER_INFO:
*************************** 4. row ***************************
SVR_IP: xxx.21
SVR_PORT: 2882
TENANT_ID: 1002
LS_ID: 1001
TABLET_ID: 1152921504606950566
TYPE: MDS_MINOR_MERGE
COMPACTION_SCN: 1771382063115799004
START_TIME: 2026-02-18 10:34:53.237713
FINISH_TIME: 2026-02-18 10:34:53.289412
TASK_ID: YB420A8C7315-00064892B6053FE0-0-0
OCCUPY_SIZE: 494
MACRO_BLOCK_COUNT: 1
MULTIPLEXED_MACRO_BLOCK_COUNT: 0
NEW_MICRO_COUNT_IN_NEW_MACRO: 1
MULTIPLEXED_MICRO_COUNT_IN_NEW_MACRO: 0
TOTAL_ROW_COUNT: 1
INCREMENTAL_ROW_COUNT: 1
COMPRESSION_RATIO: 1
NEW_FLUSH_DATA_RATE: 97
PROGRESSIVE_COMPACTION_ROUND: 0
PROGRESSIVE_COMPACTION_NUM: 0
PARALLEL_DEGREE: 1
PARALLEL_INFO: -
PARTICIPANT_TABLE: table_cnt=2,start_scn=1,end_scn=1771382063115799004;
MACRO_ID_LIST: 10884420
COMMENTS: comment=“cost_mb=2;”;
START_CG_ID: 0
END_CG_ID: 0
KEPT_SNAPSHOT:
MERGE_LEVEL: MACRO_BLOCK_LEVEL
EXEC_MODE: EXEC_MODE_LOCAL
IS_FULL_MERGE: FALSE
IO_COST_TIME_PERCENTAGE: 11
MERGE_REASON:
BASE_MAJOR_STATUS:
CO_MERGE_TYPE:
MDS_FILTER_INFO:
*************************** 5. row ***************************
SVR_IP: xxx.21
SVR_PORT: 2882
TENANT_ID: 1002
LS_ID: 1001
TABLET_ID: 1152921504606950566
TYPE: MAJOR_MERGE
COMPACTION_SCN: 1771378775520306000
START_TIME: 2026-02-18 09:51:10.397256
FINISH_TIME: 2026-02-18 09:51:10.424421
TASK_ID: YB420A8C7315-00064892B604E494-0-0
OCCUPY_SIZE: 0
MACRO_BLOCK_COUNT: 0
MULTIPLEXED_MACRO_BLOCK_COUNT: 0
NEW_MICRO_COUNT_IN_NEW_MACRO: 0
MULTIPLEXED_MICRO_COUNT_IN_NEW_MACRO: 0
TOTAL_ROW_COUNT: 0
INCREMENTAL_ROW_COUNT: 0
COMPRESSION_RATIO: 1
NEW_FLUSH_DATA_RATE: 0
PROGRESSIVE_COMPACTION_ROUND: 1
PROGRESSIVE_COMPACTION_NUM: 0
PARALLEL_DEGREE: 1
PARALLEL_INFO: -
PARTICIPANT_TABLE: table_cnt=1,[MAJOR]snapshot_version=1771351201207505001;
MACRO_ID_LIST:
COMMENTS: comment=“time=add_time:1771378950967672|wait_schedule_time=519.43s;”;
START_CG_ID: 0
END_CG_ID: 0
KEPT_SNAPSHOT: {type:“LS_RESERVED”, snapshot:1771377657527834000}
MERGE_LEVEL: MICRO_BLOCK_LEVEL
EXEC_MODE: EXEC_MODE_LOCAL
IS_FULL_MERGE: FALSE
IO_COST_TIME_PERCENTAGE: 0
MERGE_REASON: TENANT_MAJOR
BASE_MAJOR_STATUS:
CO_MERGE_TYPE:
MDS_FILTER_INFO:
*************************** 6. row ***************************
SVR_IP: xxx.xx.xx.25
SVR_PORT: 2882
TENANT_ID: 1002
LS_ID: 1001
TABLET_ID: 1152921504606950566
TYPE: MDS_MINOR_MERGE
COMPACTION_SCN: 1771378775526641001
START_TIME: 2026-02-18 09:39:58.120076
FINISH_TIME: 2026-02-18 09:39:58.149435
TASK_ID: YB420A8C0619-000649F379AFB468-0-0
OCCUPY_SIZE: 494
MACRO_BLOCK_COUNT: 1
MULTIPLEXED_MACRO_BLOCK_COUNT: 0
NEW_MICRO_COUNT_IN_NEW_MACRO: 1
MULTIPLEXED_MICRO_COUNT_IN_NEW_MACRO: 0
TOTAL_ROW_COUNT: 1
INCREMENTAL_ROW_COUNT: 1
COMPRESSION_RATIO: 1
NEW_FLUSH_DATA_RATE: 127
PROGRESSIVE_COMPACTION_ROUND: 0
PROGRESSIVE_COMPACTION_NUM: 0
PARALLEL_DEGREE: 1
PARALLEL_INFO: -
PARTICIPANT_TABLE: table_cnt=2,start_scn=1,end_scn=1771378775526641001;
MACRO_ID_LIST: 8754494
COMMENTS: comment=“cost_mb=2;”;
START_CG_ID: 0
END_CG_ID: 0
KEPT_SNAPSHOT:
MERGE_LEVEL: MACRO_BLOCK_LEVEL
EXEC_MODE: EXEC_MODE_LOCAL
IS_FULL_MERGE: FALSE
IO_COST_TIME_PERCENTAGE: 11
MERGE_REASON:
BASE_MAJOR_STATUS:
CO_MERGE_TYPE:
MDS_FILTER_INFO:
*************************** 7. row ***************************
SVR_IP: xxx.21
SVR_PORT: 2882
TENANT_ID: 1002
LS_ID: 1001
TABLET_ID: 1152921504606950566
TYPE: MDS_MINOR_MERGE
COMPACTION_SCN: 1771378775526641001
START_TIME: 2026-02-18 09:39:56.100272
FINISH_TIME: 2026-02-18 09:39:56.150963
TASK_ID: YB420A8C7315-00064892B6047357-0-0
OCCUPY_SIZE: 494
MACRO_BLOCK_COUNT: 1
MULTIPLEXED_MACRO_BLOCK_COUNT: 0
NEW_MICRO_COUNT_IN_NEW_MACRO: 1
MULTIPLEXED_MICRO_COUNT_IN_NEW_MACRO: 0
TOTAL_ROW_COUNT: 1
INCREMENTAL_ROW_COUNT: 1
COMPRESSION_RATIO: 1
NEW_FLUSH_DATA_RATE: 113
PROGRESSIVE_COMPACTION_ROUND: 0
PROGRESSIVE_COMPACTION_NUM: 0
PARALLEL_DEGREE: 1
PARALLEL_INFO: -
PARTICIPANT_TABLE: table_cnt=2,start_scn=1,end_scn=1771378775526641001;
MACRO_ID_LIST: 10816491
COMMENTS: comment=“cost_mb=2;”;
START_CG_ID: 0
END_CG_ID: 0
KEPT_SNAPSHOT:
MERGE_LEVEL: MACRO_BLOCK_LEVEL
EXEC_MODE: EXEC_MODE_LOCAL
IS_FULL_MERGE: FALSE
IO_COST_TIME_PERCENTAGE: 6
MERGE_REASON:
BASE_MAJOR_STATUS:
CO_MERGE_TYPE:
MDS_FILTER_INFO:
*************************** 8. row ***************************
SVR_IP: xxx.27
SVR_PORT: 2882
TENANT_ID: 1002
LS_ID: 1001
TABLET_ID: 1152921504606950566
TYPE: MDS_MINOR_MERGE
COMPACTION_SCN: 1771378775325596001
START_TIME: 2026-02-18 09:39:53.008121
FINISH_TIME: 2026-02-18 09:39:53.012397
TASK_ID: YB420A8CA71B-00064AC29DEB450D-0-0
OCCUPY_SIZE: 494
MACRO_BLOCK_COUNT: 1
MULTIPLEXED_MACRO_BLOCK_COUNT: 0
NEW_MICRO_COUNT_IN_NEW_MACRO: 1
MULTIPLEXED_MICRO_COUNT_IN_NEW_MACRO: 0
TOTAL_ROW_COUNT: 1
INCREMENTAL_ROW_COUNT: 1
COMPRESSION_RATIO: 1
NEW_FLUSH_DATA_RATE: 135
PROGRESSIVE_COMPACTION_ROUND: 0
PROGRESSIVE_COMPACTION_NUM: 0
PARALLEL_DEGREE: 1
PARALLEL_INFO: -
PARTICIPANT_TABLE: table_cnt=2,start_scn=1,end_scn=1771378775325596001;
MACRO_ID_LIST: 4123768
COMMENTS: comment=“cost_mb=2;”;
START_CG_ID: 0
END_CG_ID: 0
KEPT_SNAPSHOT:
MERGE_LEVEL: MACRO_BLOCK_LEVEL
EXEC_MODE: EXEC_MODE_LOCAL
IS_FULL_MERGE: FALSE
IO_COST_TIME_PERCENTAGE: 5
MERGE_REASON:
BASE_MAJOR_STATUS:
CO_MERGE_TYPE:
MDS_FILTER_INFO:
*************************** 9. row ***************************
SVR_IP: xxx.xx.xx.25
SVR_PORT: 2882
TENANT_ID: 1002
LS_ID: 1001
TABLET_ID: 1152921504606950566
TYPE: MAJOR_MERGE
COMPACTION_SCN: 1771351201207505001
START_TIME: 2026-02-18 03:50:44.785472
FINISH_TIME: 2026-02-18 03:50:44.817726
TASK_ID: YB420A8C0619-000649F379AF7554-0-0
OCCUPY_SIZE: 0
MACRO_BLOCK_COUNT: 0
MULTIPLEXED_MACRO_BLOCK_COUNT: 0
NEW_MICRO_COUNT_IN_NEW_MACRO: 0
MULTIPLEXED_MICRO_COUNT_IN_NEW_MACRO: 0
TOTAL_ROW_COUNT: 0
INCREMENTAL_ROW_COUNT: 0
COMPRESSION_RATIO: 1
NEW_FLUSH_DATA_RATE: 0
PROGRESSIVE_COMPACTION_ROUND: 1
PROGRESSIVE_COMPACTION_NUM: 0
PARALLEL_DEGREE: 1
PARALLEL_INFO: -
PARTICIPANT_TABLE: table_cnt=1,[MAJOR]snapshot_version=1771264800417984001;
MACRO_ID_LIST:
COMMENTS: comment=“time=add_time:1771352393896618|wait_schedule_time=5450.89s;”;
START_CG_ID: 0
END_CG_ID: 0
KEPT_SNAPSHOT: {type:“MAJOR_FREEZE_TS”, snapshot:1771351201207505001}
MERGE_LEVEL: MICRO_BLOCK_LEVEL
EXEC_MODE: EXEC_MODE_LOCAL
IS_FULL_MERGE: FALSE
IO_COST_TIME_PERCENTAGE: 0
MERGE_REASON: TENANT_MAJOR
BASE_MAJOR_STATUS:
CO_MERGE_TYPE:
MDS_FILTER_INFO:
*************************** 10. row ***************************
SVR_IP: xxx.27
SVR_PORT: 2882
TENANT_ID: 1002
LS_ID: 1001
TABLET_ID: 1152921504606950566
TYPE: MAJOR_MERGE
COMPACTION_SCN: 1771351201207505001
START_TIME: 2026-02-18 03:46:22.609295
FINISH_TIME: 2026-02-18 03:46:22.620950
TASK_ID: YB420A8CA71B-00064AC29DEB0A23-0-0
OCCUPY_SIZE: 0
MACRO_BLOCK_COUNT: 0
MULTIPLEXED_MACRO_BLOCK_COUNT: 0
NEW_MICRO_COUNT_IN_NEW_MACRO: 0
MULTIPLEXED_MICRO_COUNT_IN_NEW_MACRO: 0
TOTAL_ROW_COUNT: 0
INCREMENTAL_ROW_COUNT: 0
COMPRESSION_RATIO: 1
NEW_FLUSH_DATA_RATE: 0
PROGRESSIVE_COMPACTION_ROUND: 1
PROGRESSIVE_COMPACTION_NUM: 0
PARALLEL_DEGREE: 1
PARALLEL_INFO: -
PARTICIPANT_TABLE: table_cnt=1,[MAJOR]snapshot_version=1771264800417984001;
MACRO_ID_LIST:
COMMENTS: comment=“time=add_time:1771352108117214|wait_schedule_time=5474.49s;”;
START_CG_ID: 0
END_CG_ID: 0
KEPT_SNAPSHOT: {type:“MAJOR_FREEZE_TS”, snapshot:1771351201207505001}
MERGE_LEVEL: MICRO_BLOCK_LEVEL
EXEC_MODE: EXEC_MODE_LOCAL
IS_FULL_MERGE: FALSE
IO_COST_TIME_PERCENTAGE: 0
MERGE_REASON: TENANT_MAJOR
BASE_MAJOR_STATUS:
CO_MERGE_TYPE:
MDS_FILTER_INFO:
10 rows in set (1.42 sec)
ERROR:
No query specified
【复现路径】问题出现前后相关操作
【附件及日志】推荐使用OceanBase敏捷诊断工具obdiag收集诊断信息,详情参见链接(右键跳转查看):
【备注】基于 LLM 和开源文档 RAG 的论坛小助手已开放测试,在发帖时输入 [@论坛小助手] 即可召唤小助手,欢迎试用!