【 使用环境 】生产环境
【 OB or 其他组件 】oblogproxy
【 使用版本 】4.2 企业版
【问题描述】
使用flink-cdc+ oblogproxy 获取oceanbase日志数据时,oblogproxy日志报错如下:
[2025-06-13 15:54:04.905201] [warning] http.cpp(113): Failed to invoke evdns_base_new, just skip
[2025-06-13 15:54:05.060920] [warning] http.cpp(113): Failed to invoke evdns_base_new, just skip
[2025-06-13 15:54:05.213922] [warning] comm.cpp(72): >>> Communicator disabled listening, fd: 9
【复现路径】问题出现前后相关操作
【附件及日志】详细日志如下
[2025-06-13 15:53:30.394447] [info] environmental.cpp(17): Max file descriptors: 180000
[2025-06-13 15:53:30.394465] [info] environmental.cpp(24): Max processes/threads: 128000
[2025-06-13 15:53:30.394468] [info] environmental.cpp(31): Core dump size: 18446744073709551615
[2025-06-13 15:53:30.394471] [info] environmental.cpp(38): Maximum number of pending signals: 1544474
[2025-06-13 15:53:30.395114] [info] channel_factory.cpp(49): ChannelFactory init with server mode
[2025-06-13 15:53:30.395176] [info] comm.cpp(105): +++ Listen on port: 2983, fd: 9
[2025-06-13 15:53:30.395410] [info] comm.cpp(111): +++ Communicator about to start
[2025-06-13 15:53:30.395563] [info] file_gc.cpp(180): file gc size quota MB: 5242880
[2025-06-13 15:53:30.395573] [info] file_gc.cpp(181): file gc time quota day: 7
[2025-06-13 15:53:30.395576] [info] file_gc.cpp(182): file gc path: log
[2025-06-13 15:53:30.395579] [info] file_gc.cpp(183): file gc oblogreader path: ./run
[2025-06-13 15:53:30.395582] [info] file_gc.cpp(184): file gc oblogreader path retain hour: 168
[2025-06-13 15:53:30.395585] [info] file_gc.cpp(186): file gc prefixs: binlog.converter
[2025-06-13 15:53:30.395588] [info] file_gc.cpp(186): file gc prefixs: binlog_converter.2
[2025-06-13 15:53:30.395591] [info] file_gc.cpp(186): file gc prefixs: liboblog.log.2
[2025-06-13 15:53:30.395594] [info] file_gc.cpp(186): file gc prefixs: logproxy.2
[2025-06-13 15:53:30.395596] [info] file_gc.cpp(186): file gc prefixs: logproxy_
[2025-06-13 15:53:30.395598] [info] file_gc.cpp(186): file gc prefixs: trace_record_read.2
[2025-06-13 15:53:40.395684] [info] status_thread.cpp(42): COUNTS:[NREADER:0][NCHANNEL:0]
[2025-06-13 15:53:42.458690] [info] status_thread.cpp(60): METRICS:[MEM:280756/386256MB,72.69%][UDISK:4690119/7628815MB,61.48%][CPU:128,48.16%][LOAD1,5:7666%,5297%][NETIO:0KB/s,0KB/s]
[2025-06-13 15:53:42.458767] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:10/386256MB,0%][UDISK:3633/7628815MB,61.48%][CPU:128,0%][NETIO:0KB/s,0KB/s]
[2025-06-13 15:53:52.458878] [info] status_thread.cpp(42): COUNTS:[NREADER:0][NCHANNEL:0]
[2025-06-13 15:53:54.467058] [info] status_thread.cpp(60): METRICS:[MEM:281787/386256MB,72.95%][UDISK:4690112/7628815MB,61.48%][CPU:128,20.48%][LOAD1,5:6566%,5171%][NETIO:59559KB/s,69329KB/s]
[2025-06-13 15:53:54.467226] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:11/386256MB,0%][UDISK:3633/7628815MB,61.48%][CPU:128,0%][NETIO:0KB/s,69329KB/s]
[2025-06-13 15:54:04.467254] [info] status_thread.cpp(42): COUNTS:[NREADER:0][NCHANNEL:0]
[2025-06-13 15:54:04.904669] [info] arranger.cpp(80): Arranger on_msg fired: id:9676753503107153924, fd:4, addr:2253044746, port:39864
[2025-06-13 15:54:04.904738] [info] arranger.cpp(87): Handshake request from peer: id:9676753503107153924, fd:4, addr:2253044746, port:39864, msg: log_type:0, id:cdc_pms_pmsprd_batch_01_1749801241643, ip:10.133.8.68, version:1.1.0, configuration:tb_white_list=PMSPRD.. cluster_user=CXPT_USER@PMSPRD#ZHUZHOU_ERP timezone=+00:00 rootserver_list= cluster_password=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx cluster_url=http://192.168.116.126:80/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=ZHUZHOU_ERP cluster_id= tb_black_list=| working_mode=storage first_start_timestamp_us=0 first_start_timestamp=1749801140 , enable_monitor:0,
[2025-06-13 15:54:04.904800] [info] arranger.cpp(99): ObConfig from peer: id:9676753503107153924, fd:4, addr:2253044746, port:39864 after resolve: cluster_id:,cluster_password:xxxxxxxx,cluster_url:http://192.168.116.126:80/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=ZHUZHOU_ERP,cluster_user:CXPT_USER@PMSPRD#ZHUZHOU_ERP,first_start_timestamp:1749801140,first_start_timestamp_us:0,id:,rootserver_list:,sys_password:,sys_user:,tb_white_list:PMSPRD..,tb_black_list:|,timezone:+00:00,working_mode:storage,
[2025-06-13 15:54:04.905201] [warning] http.cpp(113): Failed to invoke evdns_base_new, just skip
[2025-06-13 15:54:04.910982] [info] ob_access.cpp(212): About to auth user: CXPT_USER@PMSPRD#ZHUZHOU_ERP for observer: 10.99.159.132:2881
[2025-06-13 15:54:04.911885] [info] mysql_protocol.cpp(49): Connect to server success: 10.99.159.132:2881, user: root
[2025-06-13 15:54:04.913673] [info] mysql_protocol.cpp(120): Auth user success of server: 10.99.159.132:2881, user: root
[2025-06-13 15:54:04.913697] [info] ob_access.cpp(226): About to auth tenant:PMSPRD of user:CXPT_USER@PMSPRD
[2025-06-13 15:54:04.913718] [info] mysql_protocol.cpp(211): Query obmysql SQL:SELECT server.svr_ip, server.inner_port, server.zone, tenant.tenant_id, tenant.tenant_name FROM oceanbase.__all_resource_pool AS pool, oceanbase.__all_unit AS unit, oceanbase.__all_server AS server, oceanbase.__all_tenant AS tenant WHERE tenant.tenant_id=pool.tenant_id AND unit.resource_pool_id=pool.resource_pool_id AND unit.svr_ip=server.svr_ip AND unit.svr_port=server.svr_port AND tenant.tenant_name=‘PMSPRD’
[2025-06-13 15:54:04.957503] [info] mysql_protocol.cpp(49): Connect to server success: 10.99.159.135:2881, user: CXPT_USER@PMSPRD
[2025-06-13 15:54:04.958904] [info] mysql_protocol.cpp(120): Auth user success of server: 10.99.159.135:2881, user: CXPT_USER@PMSPRD
[2025-06-13 15:54:04.958949] [info] ob_access.cpp(212): About to auth user: CXPT_USER@PMSPRD#ZHUZHOU_ERP for observer: 10.99.159.133:2881
[2025-06-13 15:54:04.959662] [info] mysql_protocol.cpp(49): Connect to server success: 10.99.159.133:2881, user: root
[2025-06-13 15:54:04.961674] [info] mysql_protocol.cpp(120): Auth user success of server: 10.99.159.133:2881, user: root
[2025-06-13 15:54:04.961727] [info] ob_access.cpp(226): About to auth tenant:PMSPRD of user:CXPT_USER@PMSPRD
[2025-06-13 15:54:04.961738] [info] mysql_protocol.cpp(211): Query obmysql SQL:SELECT server.svr_ip, server.inner_port, server.zone, tenant.tenant_id, tenant.tenant_name FROM oceanbase.__all_resource_pool AS pool, oceanbase.__all_unit AS unit, oceanbase.__all_server AS server, oceanbase.__all_tenant AS tenant WHERE tenant.tenant_id=pool.tenant_id AND unit.resource_pool_id=pool.resource_pool_id AND unit.svr_ip=server.svr_ip AND unit.svr_port=server.svr_port AND tenant.tenant_name=‘PMSPRD’
[2025-06-13 15:54:05.010691] [info] mysql_protocol.cpp(49): Connect to server success: 10.99.159.135:2881, user: CXPT_USER@PMSPRD
[2025-06-13 15:54:05.012142] [info] mysql_protocol.cpp(120): Auth user success of server: 10.99.159.135:2881, user: CXPT_USER@PMSPRD
[2025-06-13 15:54:05.012223] [info] ob_access.cpp(212): About to auth user: CXPT_USER@PMSPRD#ZHUZHOU_ERP for observer: 10.99.159.134:2881
[2025-06-13 15:54:05.012940] [info] mysql_protocol.cpp(49): Connect to server success: 10.99.159.134:2881, user: root
[2025-06-13 15:54:05.014781] [info] mysql_protocol.cpp(120): Auth user success of server: 10.99.159.134:2881, user: root
[2025-06-13 15:54:05.014832] [info] ob_access.cpp(226): About to auth tenant:PMSPRD of user:CXPT_USER@PMSPRD
[2025-06-13 15:54:05.014842] [info] mysql_protocol.cpp(211): Query obmysql SQL:SELECT server.svr_ip, server.inner_port, server.zone, tenant.tenant_id, tenant.tenant_name FROM oceanbase.__all_resource_pool AS pool, oceanbase.__all_unit AS unit, oceanbase.__all_server AS server, oceanbase.__all_tenant AS tenant WHERE tenant.tenant_id=pool.tenant_id AND unit.resource_pool_id=pool.resource_pool_id AND unit.svr_ip=server.svr_ip AND unit.svr_port=server.svr_port AND tenant.tenant_name=‘PMSPRD’
[2025-06-13 15:54:05.058841] [info] mysql_protocol.cpp(49): Connect to server success: 10.99.159.135:2881, user: CXPT_USER@PMSPRD
[2025-06-13 15:54:05.060320] [info] mysql_protocol.cpp(120): Auth user success of server: 10.99.159.135:2881, user: CXPT_USER@PMSPRD
[2025-06-13 15:54:05.060920] [warning] http.cpp(113): Failed to invoke evdns_base_new, just skip
[2025-06-13 15:54:05.067926] [info] mysql_protocol.cpp(49): Connect to server success: 10.99.159.132:2881, user: root
[2025-06-13 15:54:05.069902] [info] mysql_protocol.cpp(120): Auth user success of server: 10.99.159.132:2881, user: root
[2025-06-13 15:54:05.069956] [info] mysql_protocol.cpp(211): Query obmysql SQL:SELECT svr_min_log_timestamp FROM oceanbase.__all_virtual_server_clog_stat WHERE zone_status=‘ACTIVE’;
[2025-06-13 15:54:05.143656] [info] mysql_protocol.cpp(211): Query obmysql SQL:SELECT svr_min_log_timestamp FROM oceanbase.__all_virtual_server_clog_stat WHERE zone_status=‘ACTIVE’;
[2025-06-13 15:54:05.212830] [info] arranger.cpp(215): Client connecting: type:0, id:cdc_pms_pmsprd_batch_01_1749801241643, ip:10.133.8.68, version:1.1.0, configuration:tb_white_list=PMSPRD.. cluster_user=CXPT_USER@PMSPRD#ZHUZHOU_ERP timezone=+00:00 rootserver_list= cluster_password=xxxxxxxxxxxxxxxxxxxxx cluster_url=http://192.168.116.126:80/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=ZHUZHOU_ERP cluster_id= tb_black_list=| working_mode=storage first_start_timestamp_us=0 first_start_timestamp=1749801140 , pid:0, peer:fd:4, register_time:1749801244, enable_monitor:0, packet_version:2,
[2025-06-13 15:54:05.213734] [info] source_invoke.cpp(57): +++ Created oblogreader with pid: 2537661
[2025-06-13 15:54:05.213818] [info] arranger.cpp(233): Remove peer: id:9676753503107153924, fd:4, addr:2253044746, port:39864 after source invoked, current channel count:0
[2025-06-13 15:54:05.213847] [info] arranger.cpp(238): Client connected: cdc_pms_pmsprd_batch_01_1749801241643 with peer: id:9676753503107153924, fd:4, addr:2253044746, port:39864
[2025-06-13 15:54:05.213922] [warning] comm.cpp(72): >>> Communicator disabled listening, fd: 9
[2025-06-13 15:54:05.214007] [info] comm.cpp(63): Communicator stopping
[2025-06-13 15:54:05.214024] [info] comm.cpp(65): Communicator stopped
[2025-06-13 15:54:07.499015] [info] status_thread.cpp(60): METRICS:[MEM:283129/386256MB,73.3%][UDISK:4690096/7628815MB,61.48%][CPU:128,50.79%][LOAD1,5:6021%,5100%][NETIO:75129KB/s,30010KB/s]
[2025-06-13 15:54:07.499096] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:11/386256MB,0%][UDISK:3633/7628815MB,61.48%][CPU:128,0%][NETIO:0KB/s,30010KB/s]
[2025-06-13 15:54:07.499111] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy/run/cdc_pms_pmsprd_batch_01_1749801241643][PID:2537661][MEM:46/386256MB,0%][UDISK:0/7628815MB,61.48%][CPU:128,3.96%][NETIO:0KB/s,30010KB/s]
[2025-06-13 15:54:17.499231] [info] status_thread.cpp(42): COUNTS:[NREADER:1][NCHANNEL:0]
[2025-06-13 15:54:20.825836] [info] status_thread.cpp(60): METRICS:[MEM:286740/386256MB,74.24%][UDISK:4690359/7628815MB,61.48%][CPU:128,50.92%][LOAD1,5:5951%,5132%][NETIO:105402KB/s,60879KB/s]
[2025-06-13 15:54:20.825925] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:11/386256MB,0%][UDISK:3714/7628815MB,61.48%][CPU:128,0%][NETIO:0KB/s,60879KB/s]
[2025-06-13 15:54:20.825940] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy/run/cdc_pms_pmsprd_batch_01_1749801241643][PID:2537661][MEM:1481/386256MB,0%][UDISK:80/7628815MB,61.48%][CPU:128,0.7918%][NETIO:0KB/s,60879KB/s]
[2025-06-13 15:54:30.825987] [info] status_thread.cpp(42): COUNTS:[NREADER:1][NCHANNEL:0]
[2025-06-13 15:54:33.863048] [info] status_thread.cpp(60): METRICS:[MEM:287496/386256MB,74.43%][UDISK:4690378/7628815MB,61.48%][CPU:128,26.72%][LOAD1,5:5377%,5036%][NETIO:185375KB/s,142884KB/s]
[2025-06-13 15:54:33.863112] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:11/386256MB,0%][UDISK:3714/7628815MB,61.48%][CPU:128,0%][NETIO:0KB/s,142884KB/s]
[2025-06-13 15:54:33.863122] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy/run/cdc_pms_pmsprd_batch_01_1749801241643][PID:2537661][MEM:1481/386256MB,0%][UDISK:80/7628815MB,61.48%][CPU:128,1.589%][NETIO:0KB/s,142884KB/s]
[2025-06-13 15:54:43.864000] [info] status_thread.cpp(42): COUNTS:[NREADER:1][NCHANNEL:0]
[2025-06-13 15:54:46.879420] [info] status_thread.cpp(60): METRICS:[MEM:275783/386256MB,71.4%][UDISK:4690387/7628815MB,61.48%][CPU:128,28.46%][LOAD1,5:4732%,4911%][NETIO:244894KB/s,129566KB/s]
[2025-06-13 15:54:46.879487] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:11/386256MB,0%][UDISK:3714/7628815MB,61.48%][CPU:128,0%][NETIO:0KB/s,129566KB/s]
[2025-06-13 15:54:46.879518] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy/run/cdc_pms_pmsprd_batch_01_1749801241643][PID:2537661][MEM:1482/386256MB,0%][UDISK:81/7628815MB,61.48%][CPU:128,0.7916%][NETIO:0KB/s,129566KB/s]
[2025-06-13 15:54:56.879847] [info] status_thread.cpp(42): COUNTS:[NREADER:1][NCHANNEL:0]
[2025-06-13 15:54:59.912102] [info] status_thread.cpp(60): METRICS:[MEM:280509/386256MB,72.62%][UDISK:4690422/7628815MB,61.48%][CPU:128,44.65%][LOAD1,5:5725%,5100%][NETIO:370583KB/s,240587KB/s]
[2025-06-13 15:54:59.912175] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:11/386256MB,0%][UDISK:3714/7628815MB,61.48%][CPU:128,0%][NETIO:0KB/s,240587KB/s]
[2025-06-13 15:54:59.912183] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy/run/cdc_pms_pmsprd_batch_01_1749801241643][PID:2537661][MEM:1482/386256MB,0%][UDISK:81/7628815MB,61.49%][CPU:128,1.602%][NETIO:0KB/s,240587KB/s]
[2025-06-13 15:55:09.912487] [info] status_thread.cpp(42): COUNTS:[NREADER:1][NCHANNEL:0]
[2025-06-13 15:55:12.934647] [info] status_thread.cpp(60): METRICS:[MEM:279770/386256MB,72.43%][UDISK:4690784/7628815MB,61.49%][CPU:128,26.16%][LOAD1,5:7685%,5551%][NETIO:464329KB/s,340122KB/s]
[2025-06-13 15:55:12.934713] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:11/386256MB,0%][UDISK:3714/7628815MB,61.49%][CPU:128,0%][NETIO:0KB/s,340122KB/s]
[2025-06-13 15:55:12.934723] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy/run/cdc_pms_pmsprd_batch_01_1749801241643][PID:2537661][MEM:1483/386256MB,0%][UDISK:81/7628815MB,61.49%][CPU:128,0.7947%][NETIO:0KB/s,340122KB/s]
[2025-06-13 15:55:22.935170] [info] status_thread.cpp(42): COUNTS:[NREADER:1][NCHANNEL:0]
[2025-06-13 15:55:30.905452] [info] status_thread.cpp(60): METRICS:[MEM:283765/386256MB,73.47%][UDISK:4690930/7628815MB,61.49%][CPU:128,964.1%][LOAD1,5:9120%,5971%][NETIO:477878KB/s,304091KB/s]
[2025-06-13 15:55:30.905519] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:11/386256MB,0%][UDISK:3715/7628815MB,61.49%][CPU:128,0%][NETIO:0KB/s,304091KB/s]
[2025-06-13 15:55:30.905528] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy/run/cdc_pms_pmsprd_batch_01_1749801241643][PID:2537661][MEM:1494/386256MB,0%][UDISK:81/7628815MB,61.49%][CPU:128,1.591%][NETIO:0KB/s,304091KB/s]
[2025-06-13 15:55:40.908596] [info] status_thread.cpp(42): COUNTS:[NREADER:1][NCHANNEL:0]
[2025-06-13 15:55:43.949413] [info] status_thread.cpp(60): METRICS:[MEM:285423/386256MB,73.89%][UDISK:4690997/7628815MB,61.49%][CPU:128,23.2%][LOAD1,5:8366%,5916%][NETIO:252763KB/s,235193KB/s]
[2025-06-13 15:55:43.949485] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:11/386256MB,0%][UDISK:3715/7628815MB,61.49%][CPU:128,0%][NETIO:0KB/s,235193KB/s]
[2025-06-13 15:55:43.949494] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy/run/cdc_pms_pmsprd_batch_01_1749801241643][PID:2537661][MEM:1494/386256MB,0%][UDISK:81/7628815MB,61.49%][CPU:128,0.7905%][NETIO:0KB/s,235193KB/s]
[2025-06-13 15:55:53.949873] [info] status_thread.cpp(42): COUNTS:[NREADER:1][NCHANNEL:0]
[2025-06-13 15:55:56.924619] [info] status_thread.cpp(60): METRICS:[MEM:281341/386256MB,72.84%][UDISK:4691161/7628815MB,61.49%][CPU:128,12.3%][LOAD1,5:8177%,5976%][NETIO:338356KB/s,507943KB/s]
[2025-06-13 15:55:56.924685] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy][PID:2532586][MEM:11/386256MB,0%][UDISK:3715/7628815MB,61.49%][CPU:128,0%][NETIO:0KB/s,507943KB/s]
[2025-06-13 15:55:56.924695] [info] status_thread.cpp(79): METRICS:[CLIENT_ID:/qwe1/oblogproxy/run/cdc_pms_pmsprd_batch_01_1749801241643][PID:2537661][MEM:1494/386256MB,0%][UDISK:81/7628815MB,61.49%][CPU:128,0.7891%][NETIO:0KB/s,507943KB/s]
[2025-06-13 15:56:06.925127] [info] status_thread.cpp(42): COUNTS:[NREADER:1][NCHANNEL:0]
[2025-06-13 15:56:09.959552] [info] status_thread.cpp(60): METRICS:[MEM:262910/386256MB,68.07%][UDISK:4691353/7628815MB,61.5%][CPU:128,23.43%][LOAD1,5:6962%,5813%][NETIO:348269KB/s,482704KB/s]
[2025-06-13 1
【备注】基于 LLM 和开源文档 RAG 的论坛小助手已开放测试,在发帖时输入 [@论坛小助手] 即可召唤小助手,欢迎试用!