obloader4.2.4导数报错

ob版本4.2.1
obloader版本:4.2.4
[deployer@xcsjknl-xxsn1d002-hx104w bin]$ ./obloader -h****** -P3306 -u root -t obtest -c test_region3 -p ****** -D test --table dm_d_fqz_px_dyczfk -f /home/deployer/obloader4.2.4/obtest.txt --file-suffix ‘.txt’ --external-data --cut
2023-12-12 12:14:25 [INFO] Parsed args:
[–cut] true
[–file-path] /home/deployer/obloader4.2.4/obtest.txt
[–file-suffix] .txt
[–host] ******
[–port] 3306
[–user] root
[–tenant] obtest
[–cluster] test_region3
[–password] ******
[–database] test
[–sys-user] root
[–table] [dm_d_fqz_px_dyczfk]
[–external-data] true

2023-12-12 12:14:25 [INFO] Load jdbc driver class: “com.oceanbase.jdbc.Driver” finished
2023-12-12 12:14:26 [INFO] Found 1 empty tables before executing… Elapsed: 99.18 ms
2023-12-12 12:14:26 [INFO] Binding table: “dm_d_fqz_px_dyczfk” to the file: “/home/deployer/obloader4.2.4/obtest.txt” finished
2023-12-12 12:14:26 [INFO] Split 1 data files to 1 subfiles by 64.0 MB success. Elapsed: 11.09 ms
2023-12-12 12:14:26 [INFO] Ignore to clean any tables as --truncate-table or --delete-from-table is not specified
2023-12-12 12:14:27 [INFO] Query table entry and primary key for table: “dm_d_fqz_px_dyczfk” finished. Remain: 0
2023-12-12 12:14:27 [INFO] Query the leader location of “dm_d_fqz_px_dyczfk” finished. Remain: 0
2023-12-12 12:14:28 [INFO] Calculate leader: 10.188.205.92:2881 of table “dm_d_fqz_px_dyczfk”, part: 200922. Remain: 0
2023-12-12 12:14:28 [INFO] Waiting to refresh observer load status …
2023-12-12 12:14:28 [INFO] Refresh observer load status success. Table: “dm_d_fqz_px_dyczfk”. Remain: 0
2023-12-12 12:14:28 [INFO] Refresh observer load status finished. Elapsed: 235.0 ms
2023-12-12 12:14:28 [INFO] Use c.l.d.PhasedBackoffWaitStrategy as available cpu(s) is 128
2023-12-12 12:14:28 [INFO] Create 2 slots for ring buffer finished. [10.177.80.21:2881]
2023-12-12 12:14:28 [INFO] Start 256 database writer threads finished. [10.177.80.21:2881]
2023-12-12 12:14:29 [INFO] Use c.l.d.PhasedBackoffWaitStrategy as available cpu(s) is 128
2023-12-12 12:14:29 [INFO] Create 2 slots for ring buffer finished. [10.188.205.91:2881]
2023-12-12 12:14:29 [INFO] Start 256 database writer threads finished. [10.188.205.91:2881]
2023-12-12 12:14:29 [INFO] Use c.l.d.PhasedBackoffWaitStrategy as available cpu(s) is 128
2023-12-12 12:14:29 [INFO] Create 2 slots for ring buffer finished. [10.172.147.186:2881]
2023-12-12 12:14:29 [INFO] Start 256 database writer threads finished. [10.172.147.186:2881]
2023-12-12 12:14:29 [INFO] Use c.l.d.PhasedBackoffWaitStrategy as available cpu(s) is 128
2023-12-12 12:14:29 [INFO] Create 2 slots for ring buffer finished. [10.172.147.185:2881]
2023-12-12 12:14:29 [INFO] Start 256 database writer threads finished. [10.172.147.185:2881]
2023-12-12 12:14:29 [INFO] Use c.l.d.PhasedBackoffWaitStrategy as available cpu(s) is 128
2023-12-12 12:14:29 [INFO] Create 2 slots for ring buffer finished. [10.188.205.92:2881]
2023-12-12 12:14:29 [INFO] Start 256 database writer threads finished. [10.188.205.92:2881]
2023-12-12 12:14:29 [INFO] Start 256 record file reader threads success
2023-12-12 12:14:29 [INFO] File: “/home/deployer/obloader4.2.4/obtest.txt” has been parsed finished
2023-12-12 12:14:29 [WARN] Skipped 8 problematic records for table test.dm_d_fqz_px_dyczfk. Check “logs” folder for details
2023-12-12 12:14:32 [INFO] Drain and halt the worker group finished
2023-12-12 12:14:32 [INFO] Close connections: 19 of the BIZ DataSource.
2023-12-12 12:14:32 [INFO] Shutdown task context finished
2023-12-12 12:14:32 [ERROR] Error: Skipped 8 problematic records for table test.dm_d_fqz_px_dyczfk. Check “logs” folder for details
2023-12-12 12:14:32 [INFO] ---------- Finished Tasks: 1 Running Tasks: 0 Progress: 100.00% ----------
2023-12-12 12:14:32 [INFO]

All Load Tasks Finished:


    No.#        |        Type        |             Name             |            Count             |       Status

     1          |       TABLE        |      dm_d_fqz_px_dyczfk      |            8 -> 0            |      FAILURE

Total Count: 0 End Time: 2023-12-12 12:14:32

2023-12-12 12:14:32 [INFO] Load record finished. Total Elapsed: 6.472 s
2023-12-12 12:14:32 [ERROR] System exit 1

数据库端口是3306吗

proxy 3306

数据记录是不是有问题,检查下数据

看上去是obloader解析要导入的数据文件出错,可以检查下数据文件的格式,比如一行的首尾、列分隔符是啥; 常见问题在 未指定 --column-splitter 参数。 或 数据文件中列数和表结构不匹配。

1 个赞

跳过 8 行错误数据,是不是数据格式没有正确指定?