Failed to create oblogreader

OceanBase 技术问题
#1

【 使用环境 】测试环境
【 OB or 其他组件 】oblogproxy
【 使用版本 】
【问题描述】
[log-proxy-client-worker-1-thread-1] INFO com.oceanbase.clogproxy.client.connection.ClientHandler - Connect broken of ClientId: IP地址替换_12508_1678957005租户替换.test.test1: rootserver_list=服务IP地址替换:2882:2881, cluster_user=用户名替换@租户替换, cluster_password=, tb_white_list=租户替换.test.test1, start_timestamp=0 with LogProxy: LogProxy IP替换:2983
[Thread-7] WARN com.oceanbase.clogproxy.client.connection.ClientStream - start to reconnect…
[Thread-7] WARN com.oceanbase.clogproxy.client.connection.ClientStream - reconnect SUCC
[log-proxy-client-worker-1-thread-1] INFO com.oceanbase.clogproxy.client.connection.ClientHandler - ClientId: IP地址替换_12508_1678957005租户替换.test.test1: rootserver_list=服务IP地址替换:2882:2881, cluster_user=用户名替换@租户替换, cluster_password=, tb_white_list=租户替换.test.test1, start_timestamp=0 connecting LogProxy: LogProxy IP替换:2983
[log-proxy-client-worker-1-thread-1] INFO com.oceanbase.clogproxy.client.connection.ClientHandler - Connected to LogProxyServer, ip:logproxy IP地址替换, version:替换
[Checkpoint Timer] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 2 (type=CHECKPOINT) @ 1678957009838 for job 一些敏感信息替换.
[Source: Custom Source → Sink: Print to Std. Out (1/1)#0] INFO com.ververica.cdc.connectors.oceanbase.source.OceanBaseRichSourceFunction - snapshotState checkpoint: 2 at resolvedTimestamp: -1
[jobmanager-future-thread-1] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Completed checkpoint 2 for job 一些敏感信息替换 (212 bytes in 4 ms).
[log-proxy-client-worker-1-thread-1] ERROR com.oceanbase.clogproxy.client.connection.ClientHandler - LogProxy refused handshake request: code: 1
message: “Failed to create oblogreader”

[log-proxy-client-worker-1-thread-1] ERROR com.oceanbase.clogproxy.client.connection.ClientHandler - Exception occurred ClientId: IP地址替换_12508_1678957005租户替换.test.test1: rootserver_list=服务IP地址替换:2882:2881, cluster_user=用户名替换@租户替换, cluster_password=******, tb_white_list=租户替换.test.test1, start_timestamp=0, with LogProxy: LogProxy IP替换:2983
com.oceanbase.clogproxy.client.exception.LogProxyClientException: LogProxy refused handshake request: code: 1
message: “Failed to create oblogreader”

at com.oceanbase.clogproxy.client.connection.ClientHandler.handleErrorResponse(ClientHandler.java:214)
at com.oceanbase.clogproxy.client.connection.ClientHandler.channelRead(ClientHandler.java:144)

【复现路径】问题出现前后相关操作
【问题现象及影响】

【附件】

#3

部署机器与对应的observer网络互通么

#4

网络是通的，如果不通，会报网络连接异常

LogProxyClient获取oblogproxy时Failed to create oblogreader
#5

麻烦提供下server日志，这边安排相关同学给看下

#6

可能的问题 1

检索下 server 日志 Duplication exist clientId,出现该日志说明有重复的client id 订阅，换一个client id进行订阅即可

可能的问题 2

启动iboblog末成功，可以在server上检索 Failed to start source of client ,具体末启动成功可以看详细日志，可能是资源不足导致启动iboblog 失败。可以进一步查看 1ibob1og. 10g 日志确定原因

#7

oblogproxy使用的是最新的V1.1.0版本吗？如果是V1.0是遇到过这个问题的。

#8

同问这个问题是怎么解决的？
版本信息，
flink 1.17.1
flink-cdc 2.4.2
oblogproxy-ce-1.1.3-4.x
observer-ce-4.2.1

我的flinkcdc 任务每次都是报这个错误，flink tm日志如下：
2023-11-14 12:15:33,920 ERROR com.ververica.cdc.connectors.oceanbase.source.OceanBaseRichSourceFunction [] - LogProxyClient exception
com.oceanbase.clogproxy.client.exception.LogProxyClientException: LogProxy refused handshake request: code: 1
message: “Failed to create oblogreader”

查看logproxy日志 如下：
Duplication exist clientId: ${logproxy.client.id}, close last one: 7479373615050391559 with pid: 14306

flinksql 表定义：
CREATE TEMPORARY TABLE cdc_t_user (
user_id INT,
user_name STRING,
age INT,
PRIMARY KEY (user_id) NOT ENFORCED
) WITH (
‘connector’ = ‘oceanbase-cdc’,
‘scan.startup.mode’ = ‘initial’,
‘username’ = ‘root’,
‘password’ = ‘${ob_root_pwd}’,
‘tenant-name’ = ‘sys’,
‘database-name’ = ‘test’,
‘table-name’ = ‘t_user’,
‘hostname’ = ‘host_name’,
‘port’ = ‘2881’,
‘rootserver-list’ = ‘host_name:2882:2881’,
‘logproxy.host’ = ‘host_name’,
‘logproxy.port’ = ‘2983’,
‘jdbc.driver’ = ‘com.mysql.jdbc.Driver’,
‘compatible-mode’ = ‘mysql’,
‘connect.timeout’ = ‘60000’,
‘logproxy.client.id’ = ‘t_user_logproxy_client_id_100004_2023111411’, #启动都给一个肯定唯一的id
‘working-mode’ = ‘memory’
);

网络环境是通的。

#9

新建一个帖子吧会有值班同学帮忙看的

#10

我每次都是 杀掉 oblogreader进程，然后重启oblogproxy 服务，然后再起flink-cdc-ob 任务，还是会 Failed to create oblogreader，不知道哪里有问题

#11

可以说下你这问题具体怎么解决的吗？