obloader旁路导入--报错码:OB_EAGAIN

【 使用环境 】生产环境
【 obloader 】4.3.3-RELEASE
【 OceanBase版本 】4.3.4.1
【问题描述】使用obloader旁路导入数据,最后commit报错 :OB_EAGAIN

错误原因:内部错误。已经确认的日志提交给回放引擎,但回放引擎因为某种原因长时间返回
OB EAGAIN
(表示需要重试),会报该错误码。
解决方式:内部错误码。请联系技术支持人员协助排查

使用的obloader命令如下:

#!/bin/bash

OB_LOADER_HOME="/root/ob-loader-dumper-4.3.3-RELEASE/bin"

env JAVA_HOME=$JAVA_HOME ${OB_LOADER_HOME}/obloader -h 192.168.101.51 -P 2883 -u dw@tnt_dw#ob2110 -t tnt_dw -c ob2110 -p *** -D safe_net_dw \
    --table dwd_call_details \
    --auto-column-mapping \
    --csv  \
    --tmp-path /data/load \
    --thread 300 \
    --parallel 300 \
    --direct \
    --rpc-port 2885 \
    -f 'hdfs://192.168.101.36:8020/data/export/oceanbase_import/mbf_type1/dwd_call_details_part0_199?hdfs-site-file=/backup/hdfs-site.xml&core-site-file=/backup/core-site.xml'

【复现路径】无
【附件及日志】

2025-04-15 22:22:51 [INFO] ----------   Finished Tasks: 199     Running Tasks: 1        Progress: 100.00%       ----------
2025-04-15 22:22:54 [INFO] ----------   Finished Tasks: 199     Running Tasks: 1        Progress: 100.00%       ----------
2025-04-15 22:22:57 [INFO] ----------   Finished Tasks: 199     Running Tasks: 1        Progress: 100.00%       ----------
2025-04-15 22:23:00 [INFO] ----------   Finished Tasks: 199     Running Tasks: 1        Progress: 100.00%       ----------
2025-04-15 22:23:03 [INFO] ----------   Finished Tasks: 199     Running Tasks: 1        Progress: 100.00%       ----------
2025-04-15 22:23:06 [INFO] ----------   Finished Tasks: 199     Running Tasks: 1        Progress: 100.00%       ----------
2025-04-15 22:23:07 [ERROR] Load data file: "hdfs://192.168.101.36:8020/data/export/oceanbase_import/mbf_type1/dwd_call_details_part0_199/dwd_call_details.47.csv" failed. Reason: status:ERROR, errorCode:OB_EAGAIN.
2025-04-15 22:23:07 [ERROR] Fatal error occurred while loading data from "hdfs://192.168.101.36:8020/data/export/oceanbase_import/mbf_type1/dwd_call_details_part0_199/dwd_call_details.47.csv" into table `safe_net_dw`.`dwd_call_details`. Reason: status:ERROR, errorCode:OB_EAGAIN
2025-04-15 22:23:09 [INFO] [Timer] Table: dwd_call_details, Write Elapsed: 2h 58min 28.26s, Commit Elapsed: 0ms, Total Elapsed: 6h 45min 58.84s
2025-04-15 22:23:13 [ERROR] Error: status:ERROR, errorCode:OB_EAGAIN
2025-04-15 22:23:13 [INFO] ----------   Finished Tasks: 200     Running Tasks: 0        Progress: 100.00%       ----------
2025-04-15 22:23:13 [INFO] 

All Load Tasks Finished: 



----------------------------------------------------------------------------------------------------------------------------
        No.#        |        Type        |             Name             |            Count             |       Status       
----------------------------------------------------------------------------------------------------------------------------
         1          |       TABLE        |       dwd_call_details       |       17028709404 -> 0       |      FAILURE       
----------------------------------------------------------------------------------------------------------------------------

Total Count: 0          End Time: 2025-04-15 22:23:13


2025-04-15 22:23:13 [INFO] Load record finished. Total Elapsed: 6.776 h
2025-04-15 22:23:13 [ERROR] System exit 1
1 个赞

麻烦使用obdiag收一下导入报错前后一小时的日志信息。

在线分析最近一小时的日志,诊断出出现过的错误

obdiag analyze log --since 1h

分析指定的日志文件
obdiag analyze log --files observer.log.20230831142211247

1 个赞

可以提供下tmp下的完整日志