【 使用环境 】生产环境
【 OB or 其他组件 】OMS
【 使用版本 】 4.2.6_CE 、
【问题描述】清晰明确描述问题
【复现路径】问题出现前后相关操作
OMS社区版 4.2.6_CE ,同步中文表,中文库,中文列 到OB,正向同步+增量同步 正常,反向链路失败,请问下 OMS社区版 4.2.6_CE 不支持 中文反向吗?
MySQL 8.x → OB-ce 4.2.5.1
组件监控:
Store 增量拉取组件 日志:
【 使用环境 】生产环境
【 OB or 其他组件 】OMS
【 使用版本 】 4.2.6_CE 、
【问题描述】清晰明确描述问题
【复现路径】问题出现前后相关操作
OMS社区版 4.2.6_CE ,同步中文表,中文库,中文列 到OB,正向同步+增量同步 正常,反向链路失败,请问下 OMS社区版 4.2.6_CE 不支持 中文反向吗?
MySQL 8.x → OB-ce 4.2.5.1
组件监控:
Store 增量拉取组件 日志:
没大看明白问题
提供一下store的详细日志,但确实不太应该使用中文表和中文库,感觉会有意想不到的惊喜
文件太大,分批上传 1
1 [2025-05-23 09:28:51.003509] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25197][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
2 [2025-05-23 09:28:51.004091] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25201][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
3 [2025-05-23 09:28:51.004093] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [25195][BatchIO][T0][Y0-0000000000000000-0-0] [lt=50] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
4 [2025-05-23 09:28:51.093375] INFO eloop_run (eloop.c:144) [25167][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1747963731093370, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0
5 [2025-05-23 09:28:51.207352] INFO eloop_run (eloop.c:144) [25171][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1747963731207348, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0
6 [2025-05-23 09:28:51.871234] INFO [TLOG.FETCHER] run (ob_log_start_lsn_locator.cpp:276) [25205][][T0][Y0-0000000000000000-0-0] [lt=64] no request should be launch, ignore
7 [2025-05-23 09:28:52.002560] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25199][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=52] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
8 [2025-05-23 09:28:52.002806] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25192][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
9 [2025-05-23 09:28:52.003078] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25191][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
10 [2025-05-23 09:28:52.003081] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25193][RpcIO][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
11 [2025-05-23 09:28:52.003083] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25190][RpcIO][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=1/0, request done=2/0, request doing=0/0)
12 [2025-05-23 09:28:52.003507] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25197][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=55] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
13 [2025-05-23 09:28:52.004071] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25201][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
14 [2025-05-23 09:28:52.004077] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [25195][BatchIO][T0][Y0-0000000000000000-0-0] [lt=46] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
15 [2025-05-23 09:28:52.101003] INFO eloop_run (eloop.c:144) [25167][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1747963732100998, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0
16 [2025-05-23 09:28:52.214972] INFO eloop_run (eloop.c:144) [25171][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1747963732214968, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0
17 [2025-05-23 09:28:53.002427] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25191][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
18 [2025-05-23 09:28:53.002766] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25192][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
19 [2025-05-23 09:28:53.002887] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25193][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
20 [2025-05-23 09:28:53.003089] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25190][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=1/0, request done=2/0, request doing=0/0)
21 [2025-05-23 09:28:53.003443] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25197][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
22 [2025-05-23 09:28:53.003474] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25199][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
23 [2025-05-23 09:28:53.004091] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [25195][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
24 [2025-05-23 09:28:53.004106] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25201][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
25 [2025-05-23 09:28:53.108608] INFO eloop_run (eloop.c:144) [25167][pnio1][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1747963733108603, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0
26 [2025-05-23 09:28:53.222588] INFO eloop_run (eloop.c:144) [25171][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1747963733222583, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0
27 [2025-05-23 09:28:53.967697] INFO [TLOG] update_zone_cache_ (ob_log_all_svr_cache.cpp:425) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=21] [STAT] [ALL_ZONE] INDEX=0/1 ZONE=zone1 REGION=NINGDE STORAGE_TYPE=LOCAL VERSION=8972
28 [2025-05-23 09:28:53.967748] INFO [TLOG] update_zone_cache_ (ob_log_all_svr_cache.cpp:450) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=43] [STAT] [ALL_ZONE] INDEX=0/1 ZONE=zone1 ZONE_TYPE=ReadWrite VERSION=8972
29 [2025-05-23 09:28:53.967755] INFO [TLOG] update_zone_cache_ (ob_log_all_svr_cache.cpp:454) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=7] [STAT] [ALL_ZONE] COUNT=1 VERSION=8972
30 [2025-05-23 09:28:53.967766] INFO [TLOG] purge_stale_zone_records_ (ob_log_all_svr_cache.cpp:660) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=6] [STAT] [ALL_ZONE] [PURGE] PURGE_COUNT=0 CUR_COUNT=1 VERSION=8972
31 [2025-05-23 09:28:53.968172] INFO [TLOG] update_server_cache_ (ob_log_all_svr_cache.cpp:521) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=6] [STAT] [ALL_SERVER_LIST] INDEX=0/1 SERVER_ID=1 SERVER="10.38.14.30:2882" STATUS=1(ACTIVE) ZONE=zone1 REGION=NINGDE(LOW) VERSION=8971
32 [2025-05-23 09:28:53.968183] INFO [TLOG] update_server_cache_ (ob_log_all_svr_cache.cpp:525) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=11] [STAT] [ALL_SERVER_LIST] COUNT=1 VERSION=8971
33 [2025-05-23 09:28:53.968193] INFO [TLOG] purge_stale_records_ (ob_log_all_svr_cache.cpp:646) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=5] [STAT] [ALL_SERVER_LIST] [PURGE] PURGE_COUNT=0 CUR_COUNT=1 VERSION=8971
34 [2025-05-23 09:28:53.969615] INFO [TLOG.FETCHER] add_server_or_update (ob_ls_server_list.cpp:87) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=6] add_server_or_update(next_svr_index=0, svr_items=[{server:"10.38.14.30:2882", ranges:[LSN:{0, 150557553}], priority:[is_meta_table:1 region:LOW, replica:FULL, is_leader:1]}])
35 [2025-05-23 09:28:53.969640] INFO [TLOG] get_ls_svr_list_ (ob_log_route_service.cpp:817) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=20] get_ls_svr_list_ done(ret=0, ret="OB_SUCCESS", router_key={cluster_id:1699255395, tenant_id:1112, ls_id:{id:1}}, svr_list={next_svr_index:0, svr_num:1, svr_items:[{server:"10.38.14.30:2882", ranges:[LSN:{0, 150557553}], priority:[is_meta_table:1 region:LOW, replica:FULL, is_leader:1]}]}, tg_id_=259)
36 [2025-05-23 09:28:54.002449] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25193][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
37 [2025-05-23 09:28:54.002457] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25191][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
38 [2025-05-23 09:28:54.002830] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25192][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
39 [2025-05-23 09:28:54.003068] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25197][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
40 [2025-05-23 09:28:54.003074] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25190][RpcIO][T0][Y0-0000000000000000-0-0] [lt=51] [RPC EASY STAT](log_str=conn count=1/0, request done=2/0, request doing=0/0)
41 [2025-05-23 09:28:54.003369] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25199][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
42 [2025-05-23 09:28:54.004071] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25201][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
43 [2025-05-23 09:28:54.004129] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [25195][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
44 [2025-05-23 09:28:54.116236] INFO eloop_run (eloop.c:144) [25167][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1747963734116231, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0
45 [2025-05-23 09:28:54.230198] INFO eloop_run (eloop.c:144) [25171][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1747963734230194, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0
46 [2025-05-23 09:28:54.543977] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [25088][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null})
47 [2025-05-23 09:28:54.544031] INFO [COMMON] handle (memory_dump.cpp:498) [25088][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null})
48 [2025-05-23 09:28:54.544253] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [25088][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] update_check_range(min_check_version=4480, max_check_version=4481, global_version=4482)
49 [2025-05-23 09:28:54.546400] INFO handle (memory_dump.cpp:626) [25088][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] statistics:
50 tenant_cnt: 3, max_chunk_cnt: 524288
51 tenant_id ctx_id chunk_cnt label_cnt segv_cnt
52 1 0 2 2 0
53 500 0 41 82 0
54 500 8 9 1 0
55 500 17 9 1 0
56 500 23 4 4 0
57 1112 0 1 1 0
58 cost_time: 2146
2:
931 [2025-05-23 09:29:54.687159] INFO eloop_run (eloop.c:144) [25171][pnio2][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1747963794687153, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0
932 [2025-05-23 09:29:55.002090] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25192][RpcIO][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
933 [2025-05-23 09:29:55.002684] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25190][RpcIO][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=1/0, request done=2/0, request doing=0/0)
934 [2025-05-23 09:29:55.002873] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25193][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
935 [2025-05-23 09:29:55.003075] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25197][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
936 [2025-05-23 09:29:55.003160] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25191][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
937 [2025-05-23 09:29:55.003446] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25199][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
938 [2025-05-23 09:29:55.003657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [25195][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
939 [2025-05-23 09:29:55.004085] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25201][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
940 [2025-05-23 09:29:55.152466] INFO [TLOG.FETCHER] print_stat (ob_log_fetch_stream_container_mgr.cpp:178) [25221][][T0][Y0-0000000000000000-0-0] [lt=55] [STAT] [FS_CONTAINER_POOL] USED=1 FREE=0 FIXED=16 DYNAMIC=0
941 [2025-05-23 09:29:55.152505] INFO [TLOG.FETCHER] print_stat (ob_log_fetch_stream_pool.cpp:76) [25221][][T0][Y0-0000000000000000-0-0] [lt=38] [STAT] [FETCH_STREAM_POOL] USED=1 FREE=0 FIXED=16 DYNAMIC=0
942 [2025-05-23 09:29:55.152522] INFO [TLOG.FETCHER] print_stat (ob_log_fetch_log_rpc.cpp:1400) [25221][][T0][Y0-0000000000000000-0-0] [lt=16] [STAT] [RPC_RESULT_POOL] USED=2 FREE=0 FIXED=16 DYNAMIC=0
943 [2025-05-23 09:29:55.152592] INFO [TLOG.FETCHER] do_stat (ob_log_ls_fetch_stream.cpp:303) [25221][][T0][Y0-0000000000000000-0-0] [lt=14] [STAT] [FETCH_STREAM] stream="10.38.14.30:2882"(0x7f9ec4a0faa0:SYS_LS)({tenant_id:1112, ls_id:{id:1}})(FETCHED_LOG:13.49MB) traffic=0.00B/sec log_size=0 size/rpc=0.00B log_cnt/rpc=0 rpc_cnt=0(0/sec) single_rpc=0(0/sec)(upper_limit=0(0/sec),max_log=0(0/sec),no_log=0(0/sec),max_result=0(0/sec)) rpc_time=0 svr_time=(queue=0,process=0) net_time=(l2s=0,s2l=0) cb_time=0 handle_rpc_time=0 flush_time=0 read_log_time=0(log_entry=0,trans=0) trans_count=0 trans_size=0.00B
944 [2025-05-23 09:29:55.152653] INFO [TLOG.FETCHER] print_fetcher_stat_ (ob_log_fetcher.cpp:840) [25221][][T0][Y0-0000000000000000-0-0] [lt=18] [STAT] [FETCHER](upper_limit="[2025-05-22 19:29:09.682017]", dml_progress_limit_sec=30, fetcher_delay="[14:01:15.470621]")
945 [2025-05-23 09:29:55.152714] INFO [TLOG.FETCHER] print_k_slowest_ls (ob_log_ls_fetch_mgr.cpp:429) [25221][][T0][Y0-0000000000000000-0-0] [lt=19] [STAT] slow fetch progress start. ls_count=1/1
946 [2025-05-23 09:29:55.152750] INFO [TLOG.FETCHER] print_fetch_progress (ob_log_ls_fetch_ctx.cpp:1545) [25221][][T0][Y0-0000000000000000-0-0] [lt=14] [STAT] slow fetch progress idx=0/1 tls_id={tenant_id:1112, ls_id:{id:1}} mod=["10.38.14.30:2882"](0x7f9ec4a0faa0) discarded=0 delay=[14:01:15.470697] tps=0.00 progress={next_lsn:{lsn:36110701}, log_progress:"[2025-05-22 19:28:39.682017]", log_touch_tstamp:"[2025-05-22 21:00:48.048905]"}
947 [2025-05-23 09:29:55.152769] INFO [TLOG.FETCHER] print_k_slowest_ls (ob_log_ls_fetch_mgr.cpp:436) [25221][][T0][Y0-0000000000000000-0-0] [lt=18] [STAT] slow fetch progress end
948 [2025-05-23 09:29:55.152782] INFO [TLOG.FETCHER] print_k_slowest_ls (ob_log_ls_fetch_mgr.cpp:441) [25221][][T0][Y0-0000000000000000-0-0] [lt=12] [STAT] slow dispatch progress start. ls_count=1/1
949 [2025-05-23 09:29:55.152806] INFO [TLOG.FETCHER] print_dispatch_progress (ob_log_ls_fetch_ctx.cpp:1567) [25221][][T0][Y0-0000000000000000-0-0] [lt=12] [STAT] slow dispatch progress idx=0/1 tls_id={tenant_id:1112, ls_id:{id:1}} delay=[14:01:15.470698] pending_task(queue/total)=0/0 dispatch_progress=[2025-05-22 19:28:39.682016] last_dispatch_log_lsn=18446744073709551615 next_task=INVALID next_trans(log_lsn=18446744073709551615,committed=0,ready_to_commit=0,global_version=[1970-01-01 08:00:00.000000]) checkpoint=[1970-01-01 08:00:00.000000]
950 [2025-05-23 09:29:55.152823] INFO [TLOG.FETCHER] print_k_slowest_ls (ob_log_ls_fetch_mgr.cpp:448) [25221][][T0][Y0-0000000000000000-0-0] [lt=16] [STAT] slow dispatch progress end
951 [2025-05-23 09:29:55.580807] INFO eloop_run (eloop.c:144) [25167][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1747963795580801, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0
952 [2025-05-23 09:29:55.694770] INFO eloop_run (eloop.c:144) [25171][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1747963795694765, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0
953 [2025-05-23 09:29:56.002712] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25190][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=1/0, request done=2/0, request doing=0/0)
954 [2025-05-23 09:29:56.002760] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25193][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
955 [2025-05-23 09:29:56.002756] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25197][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=8] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
956 [2025-05-23 09:29:56.003080] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25191][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
957 [2025-05-23 09:29:56.003085] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25192][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
958 [2025-05-23 09:29:56.003229] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25199][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
959 [2025-05-23 09:29:56.003719] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [25195][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
960 [2025-05-23 09:29:56.004086] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25201][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
961 [2025-05-23 09:29:56.152921] INFO [TLOG.PARSER] stat_ignored_tps (ob_log_cluster_id_filter.cpp:130) [25221][][T0][Y0-0000000000000000-0-0] [lt=12] [TPS_STAT] CLUSTER_ID_IGNORED_PART_TPS=0.000
962 [2025-05-23 09:29:56.588427] INFO eloop_run (eloop.c:144) [25167][pnio1][T0][Y0-0000000000000000-0-0] [lt=243] PNIO [ratelimit] time: 1747963796588422, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0
963 [2025-05-23 09:29:56.702385] INFO eloop_run (eloop.c:144) [25171][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1747963796702380, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0
964 [2025-05-23 09:29:57.002719] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25190][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=1/0, request done=2/0, request doing=0/0)
965 [2025-05-23 09:29:57.002724] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25193][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
966 [2025-05-23 09:29:57.003099] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25191][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
967 [2025-05-23 09:29:57.003098] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25192][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
968 [2025-05-23 09:29:57.003277] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25197][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=53] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
969 [2025-05-23 09:29:57.003277] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25199][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
970 [2025-05-23 09:29:57.003658] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [25195][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
971 [2025-05-23 09:29:57.003862] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25201][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
972 [2025-05-23 09:29:57.596032] INFO eloop_run (eloop.c:144) [25167][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1747963797596028, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0
973 [2025-05-23 09:29:57.710004] INFO eloop_run (eloop.c:144) [25171][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1747963797710000, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0
974 [2025-05-23 09:29:58.002164] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25190][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=1/0, request done=2/0, request doing=0/0)
975 [2025-05-23 09:29:58.002523] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25193][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
976 [2025-05-23 09:29:58.002912] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25197][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
977 [2025-05-23 09:29:58.003020] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25199][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
978 [2025-05-23 09:29:58.003021] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25192][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
979 [2025-05-23 09:29:58.003070] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25191][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
980 [2025-05-23 09:29:58.003091] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [25195][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
981 [2025-05-23 09:29:58.003099] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25201][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
982 [2025-05-23 09:29:58.603653] INFO eloop_run (eloop.c:144) [25167][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1747963798603648, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0
983 [2025-05-23 09:29:58.717621] INFO eloop_run (eloop.c:144) [25171][pnio2][T0][Y0-0000000000000000-0-0] [lt=72] PNIO [ratelimit] time: 1747963798717617, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0
984 [2025-05-23 09:29:59.002295] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25193][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
985 [2025-05-23 09:29:59.002714] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25197][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
986 [2025-05-23 09:29:59.003083] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25191][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
987 [2025-05-23 09:29:59.003100] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25190][RpcIO][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=1/0, request done=2/0, request doing=0/0)
988 [2025-05-23 09:29:59.003106] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25192][RpcIO][T0][Y0-0000000000000000-0-0] [lt=59] [RPC EASY STAT](log_str=conn count=1/0, request done=1/0, request doing=0/0)
989 [2025-05-23 09:29:59.004083] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [25201][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
990 [2025-05-23 09:29:59.004081] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [25199][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
991 [2025-05-23 09:29:59.004088] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [25195][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0)
992 [2025-05-23 09:29:59.010294] INFO [TLOG] update_zone_cache_ (ob_log_all_svr_cache.cpp:425) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=44] [STAT] [ALL_ZONE] INDEX=0/1 ZONE=zone1 REGION=NINGDE STORAGE_TYPE=LOCAL VERSION=8985
993 [2025-05-23 09:29:59.010339] INFO [TLOG] update_zone_cache_ (ob_log_all_svr_cache.cpp:450) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=39] [STAT] [ALL_ZONE] INDEX=0/1 ZONE=zone1 ZONE_TYPE=ReadWrite VERSION=8985
994 [2025-05-23 09:29:59.010352] INFO [TLOG] update_zone_cache_ (ob_log_all_svr_cache.cpp:454) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=13] [STAT] [ALL_ZONE] COUNT=1 VERSION=8985
995 [2025-05-23 09:29:59.010371] INFO [TLOG] purge_stale_zone_records_ (ob_log_all_svr_cache.cpp:660) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=11] [STAT] [ALL_ZONE] [PURGE] PURGE_COUNT=0 CUR_COUNT=1 VERSION=8985
996 [2025-05-23 09:29:59.010784] INFO [TLOG] update_server_cache_ (ob_log_all_svr_cache.cpp:521) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=11] [STAT] [ALL_SERVER_LIST] INDEX=0/1 SERVER_ID=1 SERVER="10.38.14.30:2882" STATUS=1(ACTIVE) ZONE=zone1 REGION=NINGDE(LOW) VERSION=8984
997 [2025-05-23 09:29:59.010803] INFO [TLOG] update_server_cache_ (ob_log_all_svr_cache.cpp:525) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=19] [STAT] [ALL_SERVER_LIST] COUNT=1 VERSION=8984
998 [2025-05-23 09:29:59.010822] INFO [TLOG] purge_stale_records_ (ob_log_all_svr_cache.cpp:646) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=11] [STAT] [ALL_SERVER_LIST] [PURGE] PURGE_COUNT=0 CUR_COUNT=1 VERSION=8984
999 [2025-05-23 09:29:59.012266] INFO [TLOG.FETCHER] add_server_or_update (ob_ls_server_list.cpp:87) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=11] add_server_or_update(next_svr_index=0, svr_items=[{server:"10.38.14.30:2882", ranges:[LSN:{0, 150645031}], priority:[is_meta_table:1 region:LOW, replica:FULL, is_leader:1]}])
1000 [2025-05-23 09:29:59.012302] INFO [TLOG] get_ls_svr_list_ (ob_log_route_service.cpp:817) [25188][LogRouter][T0][Y0-0000000000000000-0-0] [lt=31] get_ls_svr_list_ done(ret=0, ret="OB_SUCCESS", router_key={cluster_id:1699255395, tenant_id:1112, ls_id:{id:1}}, svr_list={next_svr_index:0, svr_num:1, svr_items:[{server:"10.38.14.30:2882", ranges:[LSN:{0, 150645031}], priority:[is_meta_table:1 region:LOW, replica:FULL, is_leader:1]}]}, tg_id_=259)
就是 MySQL 中文 对象 迁移到ob ,正向同步正常,反向同步 就一直延迟 。看store。log 也没有报错
日志 外发被拦截了。有邮箱没?
我记得我加你们钉钉了是livedba的钉钉号 让他发我钉钉上吧
libobcdc日志上传一下看看
oms容器内执行一下 ls -lrt /home/ds/lib64/reader/ob-ce-4.2.2-reader 看一下
如果需要反向增量还是重新建一条链路比较好,不支持只增加一条反向增量这样操作 会造成数据有问题的