datax3.0导入mysql到ob4.0报错,没有合适的驱动

【 使用环境 】测试环境
【 OB or 其他组件 】
OB4.0 DataX 3.0
【问题描述】
2023-03-21 21:54:27.176 [job-0] ERROR RetryUtil - Exception when calling callable, 异常Msg:Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).]. - 具体错误信息为:java.sql.SQLException: No suitable driver found for ["||dsc_ob10_dsc||test:testtenant||dsc_ob10_dsc||jdbc:oceanbase://127.0.0.1:2881/testtest"]
com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).]. - 具体错误信息为:java.sql.SQLException: No suitable driver found for ["||dsc_ob10_dsc||test:testtenant||dsc_ob10_dsc||jdbc:oceanbase://127.0.0.1:2881/testtest"]

[root@cui-work0 libs]#  ls -l /root/datax/plugin/writer/oceanbasev10writer/libs
total 13480
-rw-r--r-- 1 root root  518641 Oct 26 15:56 commons-collections-3.0.jar
-rw-r--r-- 1 root root  185140 Oct 26 15:56 commons-io-2.4.jar
-rw-r--r-- 1 root root  412739 Oct 26 15:56 commons-lang3-3.3.2.jar
-rw-r--r-- 1 root root 1599627 Oct 26 15:56 commons-math3-3.1.1.jar
-rw-r--r-- 1 root root  118856 Oct 26 15:56 datax-common-0.0.1-SNAPSHOT.jar
-rw-r--r-- 1 root root 1952759 Oct 26 15:56 druid-1.0.15.jar
-rw-r--r-- 1 root root  375938 Oct 26 15:56 fastjson-1.1.46.sec10.jar
-rw-r--r-- 1 root root  934783 Oct 26 15:56 guava-r05.jar
-rw-r--r-- 1 root root   45024 Oct 26 15:56 hamcrest-core-1.3.jar
-rw-r--r-- 1 root root   54495 Oct 26 15:56 json-20160810.jar
-rw-r--r-- 1 root root  481535 Oct 26 15:56 log4j-1.2.16.jar
-rw-r--r-- 1 root root  264600 Oct 26 15:56 logback-classic-1.0.13.jar
-rw-r--r-- 1 root root  418870 Oct 26 15:56 logback-core-1.0.13.jar
-rw-r--r-- 1 root root 3549756 Oct 26 15:56 oceanbase-client-1.1.10.jar
-rw-r--r-- 1 root root 2732497 Oct 26 15:56 oceanbase-connector-java-3.2.0.jar
-rw-r--r-- 1 root root   92894 Oct 26 15:56 plugin-rdbms-util-0.0.1-SNAPSHOT.jar
-rw-r--r-- 1 root root   32119 Oct 26 15:56 slf4j-api-1.7.10.jar
[root@cui-work0 libs]#

在lib里放入对应得驱动。
datax的json配置中是jdbc:mysql就放mysql驱动。是jdbc:oceanbase就放适配的ob驱动

是要把 /root/datax/plugin/writer/oceanbasev10writer/libs 目录下的 connector 放到 /root/datax/lib目录下吗?

mysql 的reader 驱动就在对应的plugin的目录下的lib里, /root/datax/lib下也是没有的

看到你已经放进去了。

是这个版本吗?Release datax_v202210 · alibaba/DataX · GitHub

1 个赞

是的… (非得要5个字符)

Oceanbase使用这个2个前置条件,1.需要部署obproxy 2. 数据库用户一定需要设置密码 我看你还是用的默认2881端口号,应该是直连ob的吧?

  1. 使用DataX必须用obproxy吗?
  2. 密码是设置过的

是的,里面连接串得写连obproxy

1 个赞

好的 我试试 多谢

连接串改成obproxy后 还是报相同的错误

[root@cui-work0 datax]# python ./bin/datax.py ./job/mysql2ob.json

DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.


2023-03-22 04:11:13.983 [main] INFO  MessageSource - JVM TimeZone: GMT+08:00, Locale: zh_CN
2023-03-22 04:11:13.987 [main] INFO  MessageSource - use Locale: zh_CN timeZone: sun.util.calendar.ZoneInfo[id="GMT+08:00",offset=28800000,dstSavings=0,useDaylight=false,transitions=0,lastRule=null]
2023-03-22 04:11:14.005 [main] INFO  VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl
2023-03-22 04:11:14.012 [main] INFO  Engine - the machine info  => 

        osInfo: Oracle Corporation 1.8 25.202-b08
        jvmInfo:        Linux amd64 3.10.0-1127.el7.x86_64
        cpu num:        8

        totalPhysicalMemory:    -0.00G
        freePhysicalMemory:     -0.00G
        maxFileDescriptorCount: -1
        currentOpenFileDescriptorCount: -1

        GC Names        [PS MarkSweep, PS Scavenge]

        MEMORY_NAME                    | allocation_size                | init_size                      
        PS Eden Space                  | 256.00MB                       | 256.00MB                       
        Code Cache                     | 240.00MB                       | 2.44MB                         
        Compressed Class Space         | 1,024.00MB                     | 0.00MB                         
        PS Survivor Space              | 42.50MB                        | 42.50MB                        
        PS Old Gen                     | 683.00MB                       | 683.00MB                       
        Metaspace                      | -0.00MB                        | 0.00MB                         


2023-03-22 04:11:14.036 [main] INFO  Engine - 
{
        "content":[
                {
                        "reader":{
                                "name":"mysqlreader",
                                "parameter":{
                                        "column":[
                                                "*"
                                        ],
                                        "connection":[
                                                {
                                                        "jdbcUrl":[
                                                                "jdbc:mysql://10.18.13.224:3306/tpcc?useUnicode=true&characterEncoding=utf8"
                                                        ],
                                                        "table":[
                                                                "warehouse"
                                                        ]
                                                }
                                        ],
                                        "password":"****",
                                        "username":"tpcc"
                                }
                        },
                        "writer":{
                                "name":"oceanbasev10writer",
                                "parameter":{
                                        "batchSize":100,
                                        "column":[
                                                "*"
                                        ],
                                        "connection":[
                                                {
                                                        "jdbcUrl":[
                                                                "||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"
                                                        ],
                                                        "table":[
                                                                "warehouse"
                                                        ]
                                                }
                                        ],
                                        "memstoreThreshold":"0.9",
                                        "obWriteMode":"insert",
                                        "password":"******",
                                        "username":"testuser",
                                        "writerThreadCount":10
                                }
                        }
                }
        ],
        "setting":{
                "errorLimit":{
                        "percentage":0.1,
                        "record":0
                },
                "speed":{
                        "channel":4
                }
        }
}

2023-03-22 04:11:14.065 [main] WARN  Engine - prioriy set to 0, because NumberFormatException, the value is: null
2023-03-22 04:11:14.067 [main] INFO  PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0
2023-03-22 04:11:14.068 [main] INFO  JobContainer - DataX jobContainer starts job.
2023-03-22 04:11:14.070 [main] INFO  JobContainer - Set jobId = 0
2023-03-22 04:11:14.434 [job-0] INFO  OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://10.18.13.224:3306/tpcc?useUnicode=true&characterEncoding=utf8&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true.
2023-03-22 04:11:14.436 [job-0] WARN  OriginalConfPretreatmentUtil - 您的配置文件中的列配置存在一定的风险. 因为您未配置读取数据库表的列,当您的表字段个数、类型有变动时,可能影响任务正确性甚至会运行出错。请检查您的配置并作出修改.
2023-03-22 04:11:14.482 [job-0] ERROR RetryUtil - Exception when calling callable, 异常Msg:Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).].  -  具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]
com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).].  -  具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]
        at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:30) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.RdbmsException.asConnException(RdbmsException.java:36) ~[plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.connect(DBUtil.java:397) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.connect(DBUtil.java:387) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.access$000(DBUtil.java:22) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil$3.call(DBUtil.java:322) ~[plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil$3.call(DBUtil.java:319) ~[plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.common.util.RetryUtil$Retry.call(RetryUtil.java:164) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.common.util.RetryUtil$Retry.doRetry(RetryUtil.java:111) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.common.util.RetryUtil.executeWithRetry(RetryUtil.java:30) [datax-common-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:319) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:303) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.util.DbUtils.fetchSingleValueWithRetry(DbUtils.java:50) [oceanbasev10writer-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.checkCompatibleMode(OceanBaseV10Writer.java:196) [oceanbasev10writer-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.init(OceanBaseV10Writer.java:61) [oceanbasev10writer-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.job.JobContainer.initJobWriter(JobContainer.java:704) [datax-core-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.job.JobContainer.init(JobContainer.java:304) [datax-core-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:113) [datax-core-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.Engine.start(Engine.java:93) [datax-core-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.Engine.entry(Engine.java:175) [datax-core-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.Engine.main(Engine.java:208) [datax-core-0.0.1-SNAPSHOT.jar:na]
2023-03-22 04:11:15.483 [job-0] ERROR RetryUtil - Exception when calling callable, 即将尝试执行第1次重试.本次重试计划等待[1000]ms,实际等待[1000]ms, 异常Msg:[Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).].  -  具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]]
2023-03-22 04:11:17.485 [job-0] ERROR RetryUtil - Exception when calling callable, 即将尝试执行第2次重试.本次重试计划等待[2000]ms,实际等待[2000]ms, 异常Msg:[Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).].  -  具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]]
2023-03-22 04:11:21.486 [job-0] ERROR RetryUtil - Exception when calling callable, 即将尝试执行第3次重试.本次重试计划等待[4000]ms,实际等待[4000]ms, 异常Msg:[Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).].  -  具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]]
^C[Error] DataX receive unexpected signal 2, starts to suicide.
2023-03-22 16:11:25
Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.202-b08 mixed mode):

"SIGINT handler" #12 daemon prio=9 os_prio=0 tid=0x00007fa478001000 nid=0x1e21 runnable [0x00007fa49b147000]
   java.lang.Thread.State: RUNNABLE
        at java.lang.Thread.run(Thread.java:747)

"Abandoned connection cleanup thread" #11 daemon prio=5 os_prio=0 tid=0x00007fa4c084b000 nid=0x1de3 in Object.wait() [0x00007fa49b249000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000ed3a53f0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
        - locked <0x00000000ed3a53f0> (a java.lang.ref.ReferenceQueue$Lock)
        at com.alipay.oceanbase.jdbc.AbandonedConnectionCleanupThread.run(AbandonedConnectionCleanupThread.java:43)

"Abandoned connection cleanup thread" #10 daemon prio=5 os_prio=0 tid=0x00007fa4c064d000 nid=0x1de2 in Object.wait() [0x00007fa4a8147000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000ec5bf560> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
        - locked <0x00000000ec5bf560> (a java.lang.ref.ReferenceQueue$Lock)
        at com.mysql.jdbc.AbandonedConnectionCleanupThread.run(AbandonedConnectionCleanupThread.java:64)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"Service Thread" #9 daemon prio=9 os_prio=0 tid=0x00007fa4c00e6000 nid=0x1dd4 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread3" #8 daemon prio=9 os_prio=0 tid=0x00007fa4c00c9000 nid=0x1dd3 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007fa4c00c6800 nid=0x1dd2 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007fa4c00c4800 nid=0x1dd1 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007fa4c00c1800 nid=0x1dd0 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007fa4c00c0000 nid=0x1dcf waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007fa4c008d000 nid=0x1dce in Object.wait() [0x00007fa4b04f3000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000eab08ed0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
        - locked <0x00000000eab08ed0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)

"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007fa4c008a800 nid=0x1dcd in Object.wait() [0x00007fa4b05f4000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000eab06bf8> (a java.lang.ref.Reference$Lock)
        at java.lang.Object.wait(Object.java:502)
        at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
        - locked <0x00000000eab06bf8> (a java.lang.ref.Reference$Lock)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

"job-0" #1 prio=5 os_prio=0 tid=0x00007fa4c000a800 nid=0x1dc3 waiting on condition [0x00007fa4c9868000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at com.alibaba.datax.common.util.RetryUtil$Retry.doRetry(RetryUtil.java:148)
        at com.alibaba.datax.common.util.RetryUtil.executeWithRetry(RetryUtil.java:30)
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:319)
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:303)
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.util.DbUtils.fetchSingleValueWithRetry(DbUtils.java:50)
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.checkCompatibleMode(OceanBaseV10Writer.java:196)
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.init(OceanBaseV10Writer.java:61)
        at com.alibaba.datax.core.job.JobContainer.initJobWriter(JobContainer.java:704)
        at com.alibaba.datax.core.job.JobContainer.init(JobContainer.java:304)
        at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:113)
        at com.alibaba.datax.core.Engine.start(Engine.java:93)
        at com.alibaba.datax.core.Engine.entry(Engine.java:175)
        at com.alibaba.datax.core.Engine.main(Engine.java:208)

"VM Thread" os_prio=0 tid=0x00007fa4c0081000 nid=0x1dcc runnable 

"GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007fa4c001f800 nid=0x1dc4 runnable 

"GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007fa4c0021800 nid=0x1dc5 runnable 

"GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007fa4c0023000 nid=0x1dc6 runnable 

"GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007fa4c0025000 nid=0x1dc7 runnable 

"GC task thread#4 (ParallelGC)" os_prio=0 tid=0x00007fa4c0027000 nid=0x1dc8 runnable 

"GC task thread#5 (ParallelGC)" os_prio=0 tid=0x00007fa4c0028800 nid=0x1dc9 runnable 

"GC task thread#6 (ParallelGC)" os_prio=0 tid=0x00007fa4c002a800 nid=0x1dca runnable 

"GC task thread#7 (ParallelGC)" os_prio=0 tid=0x00007fa4c002c800 nid=0x1dcb runnable 

"VM Periodic Task Thread" os_prio=0 tid=0x00007fa4c00e9000 nid=0x1dd5 waiting on condition 

JNI global references: 314

Heap
 PSYoungGen      total 305664K, used 57719K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 262144K, 22% used [0x00000000eab00000,0x00000000ee35dcb0,0x00000000fab00000)
  from space 43520K, 0% used [0x00000000fd580000,0x00000000fd580000,0x0000000100000000)
  to   space 43520K, 0% used [0x00000000fab00000,0x00000000fab00000,0x00000000fd580000)
 ParOldGen       total 699392K, used 0K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 0% used [0x00000000c0000000,0x00000000c0000000,0x00000000eab00000)
 Metaspace       used 13520K, capacity 13836K, committed 13952K, reserved 1060864K
  class space    used 1485K, capacity 1612K, committed 1664K, reserved 1048576K

DataX Process was killed ! you did ?
[root@cui-work0 datax]#

show parameters like ‘cluster’; 你查看集群名称对不对,value这个值是不是test?

1 个赞

对的 完全核对过

把原来的集群destroy,用obd demo重新部署了个,还是相同的报错

[root@cui-work0 datax]# python ./bin/datax.py job/mysql2ob.json

DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.


2023-03-22 21:15:45.674 [main] INFO  MessageSource - JVM TimeZone: GMT+08:00, Locale: zh_CN
2023-03-22 21:15:45.678 [main] INFO  MessageSource - use Locale: zh_CN timeZone: sun.util.calendar.ZoneInfo[id="GMT+08:00",offset=28800000,dstSavings=0,useDaylight=false,transitions=0,lastRule=null]
2023-03-22 21:15:45.695 [main] INFO  VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl
2023-03-22 21:15:45.702 [main] INFO  Engine - the machine info  => 

        osInfo: Oracle Corporation 1.8 25.202-b08
        jvmInfo:        Linux amd64 3.10.0-1127.el7.x86_64
        cpu num:        8

        totalPhysicalMemory:    -0.00G
        freePhysicalMemory:     -0.00G
        maxFileDescriptorCount: -1
        currentOpenFileDescriptorCount: -1

        GC Names        [PS MarkSweep, PS Scavenge]

        MEMORY_NAME                    | allocation_size                | init_size                      
        PS Eden Space                  | 256.00MB                       | 256.00MB                       
        Code Cache                     | 240.00MB                       | 2.44MB                         
        Compressed Class Space         | 1,024.00MB                     | 0.00MB                         
        PS Survivor Space              | 42.50MB                        | 42.50MB                        
        PS Old Gen                     | 683.00MB                       | 683.00MB                       
        Metaspace                      | -0.00MB                        | 0.00MB                         


2023-03-22 21:15:45.735 [main] INFO  Engine - 
{
        "content":[
                {
                        "reader":{
                                "name":"mysqlreader",
                                "parameter":{
                                        "column":[
                                                "*"
                                        ],
                                        "connection":[
                                                {
                                                        "jdbcUrl":[
                                                                "jdbc:mysql://10.18.13.224:3306/tpcc?useUnicode=true&characterEncoding=utf8"
                                                        ],
                                                        "table":[
                                                                "warehouse"
                                                        ]
                                                }
                                        ],
                                        "password":"****",
                                        "username":"tpcc"
                                }
                        },
                        "writer":{
                                "name":"oceanbasev10writer",
                                "parameter":{
                                        "batchSize":100,
                                        "column":[
                                                "*"
                                        ],
                                        "connection":[
                                                {
                                                        "jdbcUrl":[
                                                                "||_dsc_ob10_dsc_||obcluster:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"
                                                        ],
                                                        "table":[
                                                                "warehouse"
                                                        ]
                                                }
                                        ],
                                        "memstoreThreshold":"0.9",
                                        "obWriteMode":"insert",
                                        "password":"******",
                                        "username":"testuser",
                                        "writerThreadCount":10
                                }
                        }
                }
        ],
        "setting":{
                "errorLimit":{
                        "percentage":0.1,
                        "record":0
                },
                "speed":{
                        "channel":4
                }
        }
}

2023-03-22 21:15:45.759 [main] WARN  Engine - prioriy set to 0, because NumberFormatException, the value is: null
2023-03-22 21:15:45.761 [main] INFO  PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0
2023-03-22 21:15:45.761 [main] INFO  JobContainer - DataX jobContainer starts job.
2023-03-22 21:15:45.763 [main] INFO  JobContainer - Set jobId = 0
2023-03-22 21:15:46.254 [job-0] INFO  OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://10.18.13.224:3306/tpcc?useUnicode=true&characterEncoding=utf8&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true.
2023-03-22 21:15:46.256 [job-0] WARN  OriginalConfPretreatmentUtil - 您的配置文件中的列配置存在一定的风险. 因为您未配置读取数据库表的列,当您的表字段个数、类型有变动时,可能影响任务正确性甚至会运行出错。请检查您的配置并作出修改.
2023-03-22 21:15:46.326 [job-0] ERROR RetryUtil - Exception when calling callable, 异常Msg:Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).].  -  具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||obcluster:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]
com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).].  -  具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||obcluster:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]
        at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:30) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.RdbmsException.asConnException(RdbmsException.java:36) ~[plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.connect(DBUtil.java:397) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.connect(DBUtil.java:387) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.access$000(DBUtil.java:22) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil$3.call(DBUtil.java:322) ~[plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil$3.call(DBUtil.java:319) ~[plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.common.util.RetryUtil$Retry.call(RetryUtil.java:164) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.common.util.RetryUtil$Retry.doRetry(RetryUtil.java:111) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.common.util.RetryUtil.executeWithRetry(RetryUtil.java:30) [datax-common-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:319) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:303) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.util.DbUtils.fetchSingleValueWithRetry(DbUtils.java:50) [oceanbasev10writer-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.checkCompatibleMode(OceanBaseV10Writer.java:196) [oceanbasev10writer-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.init(OceanBaseV10Writer.java:61) [oceanbasev10writer-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.job.JobContainer.initJobWriter(JobContainer.java:704) [datax-core-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.job.JobContainer.init(JobContainer.java:304) [datax-core-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:113) [datax-core-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.Engine.start(Engine.java:93) [datax-core-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.Engine.entry(Engine.java:175) [datax-core-0.0.1-SNAPSHOT.jar:na]
        at com.alibaba.datax.core.Engine.main(Engine.java:208) [datax-core-0.0.1-SNAPSHOT.jar:na]
2023-03-22 21:15:47.327 [job-0] ERROR RetryUtil - Exception when calling callable, 即将尝试执行第1次重试.本次重试计划等待[1000]ms,实际等待[1000]ms, 异常Msg:[Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).].  -  具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||obcluster:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]]
2023-03-22 21:15:49.328 [job-0] ERROR RetryUtil - Exception when calling callable, 即将尝试执行第2次重试.本次重试计划等待[2000]ms,实际等待[2000]ms, 异常Msg:[Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).].  -  具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||obcluster:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]]
^C[Error] DataX receive unexpected signal 2, starts to suicide.
2023-03-23 09:15:52
Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.202-b08 mixed mode):

"SIGINT handler" #12 daemon prio=9 os_prio=0 tid=0x00007f6d68001000 nid=0x53e3 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Abandoned connection cleanup thread" #11 daemon prio=5 os_prio=0 tid=0x00007f6db886d000 nid=0x53ca in Object.wait() [0x00007f6d6d40a000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000ed8c3f28> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
        - locked <0x00000000ed8c3f28> (a java.lang.ref.ReferenceQueue$Lock)
        at com.alipay.oceanbase.jdbc.AbandonedConnectionCleanupThread.run(AbandonedConnectionCleanupThread.java:43)

"Abandoned connection cleanup thread" #10 daemon prio=5 os_prio=0 tid=0x00007f6db8695000 nid=0x53c5 in Object.wait() [0x00007f6d6d816000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000ecaddc88> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
        - locked <0x00000000ecaddc88> (a java.lang.ref.ReferenceQueue$Lock)
        at com.mysql.jdbc.AbandonedConnectionCleanupThread.run(AbandonedConnectionCleanupThread.java:64)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"Service Thread" #9 daemon prio=9 os_prio=0 tid=0x00007f6db80d3000 nid=0x53b7 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread3" #8 daemon prio=9 os_prio=0 tid=0x00007f6db80c8800 nid=0x53b6 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007f6db80c6800 nid=0x53b5 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007f6db80c4800 nid=0x53b4 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007f6db80c1800 nid=0x53b3 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007f6db80c0000 nid=0x53b2 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f6db808d000 nid=0x53b1 in Object.wait() [0x00007f6d86c25000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000eab08ed0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
        - locked <0x00000000eab08ed0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)

"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f6db808a800 nid=0x53b0 in Object.wait() [0x00007f6d86d26000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000eab06bf8> (a java.lang.ref.Reference$Lock)
        at java.lang.Object.wait(Object.java:502)
        at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
        - locked <0x00000000eab06bf8> (a java.lang.ref.Reference$Lock)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

"job-0" #1 prio=5 os_prio=0 tid=0x00007f6db800a800 nid=0x53a6 waiting on condition [0x00007f6dbdf6b000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at com.alibaba.datax.common.util.RetryUtil$Retry.doRetry(RetryUtil.java:148)
        at com.alibaba.datax.common.util.RetryUtil.executeWithRetry(RetryUtil.java:30)
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:319)
        at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:303)
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.util.DbUtils.fetchSingleValueWithRetry(DbUtils.java:50)
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.checkCompatibleMode(OceanBaseV10Writer.java:196)
        at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.init(OceanBaseV10Writer.java:61)
        at com.alibaba.datax.core.job.JobContainer.initJobWriter(JobContainer.java:704)
        at com.alibaba.datax.core.job.JobContainer.init(JobContainer.java:304)
        at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:113)
        at com.alibaba.datax.core.Engine.start(Engine.java:93)
        at com.alibaba.datax.core.Engine.entry(Engine.java:175)
        at com.alibaba.datax.core.Engine.main(Engine.java:208)

"VM Thread" os_prio=0 tid=0x00007f6db8081000 nid=0x53af runnable 

"GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007f6db801f800 nid=0x53a7 runnable 

"GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007f6db8021800 nid=0x53a8 runnable 

"GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007f6db8023000 nid=0x53a9 runnable 

"GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007f6db8025000 nid=0x53aa runnable 

"GC task thread#4 (ParallelGC)" os_prio=0 tid=0x00007f6db8027000 nid=0x53ab runnable 

"GC task thread#5 (ParallelGC)" os_prio=0 tid=0x00007f6db8028800 nid=0x53ac runnable 

"GC task thread#6 (ParallelGC)" os_prio=0 tid=0x00007f6db802a800 nid=0x53ad runnable 

"GC task thread#7 (ParallelGC)" os_prio=0 tid=0x00007f6db802c800 nid=0x53ae runnable 

"VM Periodic Task Thread" os_prio=0 tid=0x00007f6db80d6000 nid=0x53b8 waiting on condition 

JNI global references: 314

Heap
 PSYoungGen      total 305664K, used 62961K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 262144K, 24% used [0x00000000eab00000,0x00000000ee87c7d0,0x00000000fab00000)
  from space 43520K, 0% used [0x00000000fd580000,0x00000000fd580000,0x0000000100000000)
  to   space 43520K, 0% used [0x00000000fab00000,0x00000000fab00000,0x00000000fd580000)
 ParOldGen       total 699392K, used 0K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 0% used [0x00000000c0000000,0x00000000c0000000,0x00000000eab00000)
 Metaspace       used 13514K, capacity 13836K, committed 13952K, reserved 1060864K
  class space    used 1485K, capacity 1612K, committed 1664K, reserved 1048576K

DataX Process was killed ! you did ?
[root@cui-work0 datax]#

image
你把这2个中括号去掉去试试。

1 个赞

已经试过了,不行

我在我本地试了下,加这个中括号会跟你一样报找不到驱动,去掉就好了。你去掉还是报找不到驱动吗?

1 个赞

是的
不折腾了
我直接去编译DataX的源码试试吧
本来想省事儿,下的二进制的

mysql_ob2.txt (2.1 KB)
用我这个json模板试试不,

1 个赞

重新编译了 解决了