[root@cui-work0 datax]# python ./bin/datax.py ./job/mysql2ob.json
DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.
2023-03-22 04:11:13.983 [main] INFO MessageSource - JVM TimeZone: GMT+08:00, Locale: zh_CN
2023-03-22 04:11:13.987 [main] INFO MessageSource - use Locale: zh_CN timeZone: sun.util.calendar.ZoneInfo[id="GMT+08:00",offset=28800000,dstSavings=0,useDaylight=false,transitions=0,lastRule=null]
2023-03-22 04:11:14.005 [main] INFO VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl
2023-03-22 04:11:14.012 [main] INFO Engine - the machine info =>
osInfo: Oracle Corporation 1.8 25.202-b08
jvmInfo: Linux amd64 3.10.0-1127.el7.x86_64
cpu num: 8
totalPhysicalMemory: -0.00G
freePhysicalMemory: -0.00G
maxFileDescriptorCount: -1
currentOpenFileDescriptorCount: -1
GC Names [PS MarkSweep, PS Scavenge]
MEMORY_NAME | allocation_size | init_size
PS Eden Space | 256.00MB | 256.00MB
Code Cache | 240.00MB | 2.44MB
Compressed Class Space | 1,024.00MB | 0.00MB
PS Survivor Space | 42.50MB | 42.50MB
PS Old Gen | 683.00MB | 683.00MB
Metaspace | -0.00MB | 0.00MB
2023-03-22 04:11:14.036 [main] INFO Engine -
{
"content":[
{
"reader":{
"name":"mysqlreader",
"parameter":{
"column":[
"*"
],
"connection":[
{
"jdbcUrl":[
"jdbc:mysql://10.18.13.224:3306/tpcc?useUnicode=true&characterEncoding=utf8"
],
"table":[
"warehouse"
]
}
],
"password":"****",
"username":"tpcc"
}
},
"writer":{
"name":"oceanbasev10writer",
"parameter":{
"batchSize":100,
"column":[
"*"
],
"connection":[
{
"jdbcUrl":[
"||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"
],
"table":[
"warehouse"
]
}
],
"memstoreThreshold":"0.9",
"obWriteMode":"insert",
"password":"******",
"username":"testuser",
"writerThreadCount":10
}
}
}
],
"setting":{
"errorLimit":{
"percentage":0.1,
"record":0
},
"speed":{
"channel":4
}
}
}
2023-03-22 04:11:14.065 [main] WARN Engine - prioriy set to 0, because NumberFormatException, the value is: null
2023-03-22 04:11:14.067 [main] INFO PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0
2023-03-22 04:11:14.068 [main] INFO JobContainer - DataX jobContainer starts job.
2023-03-22 04:11:14.070 [main] INFO JobContainer - Set jobId = 0
2023-03-22 04:11:14.434 [job-0] INFO OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://10.18.13.224:3306/tpcc?useUnicode=true&characterEncoding=utf8&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true.
2023-03-22 04:11:14.436 [job-0] WARN OriginalConfPretreatmentUtil - 您的配置文件中的列配置存在一定的风险. 因为您未配置读取数据库表的列,当您的表字段个数、类型有变动时,可能影响任务正确性甚至会运行出错。请检查您的配置并作出修改.
2023-03-22 04:11:14.482 [job-0] ERROR RetryUtil - Exception when calling callable, 异常Msg:Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).]. - 具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]
com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).]. - 具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]
at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:30) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.rdbms.util.RdbmsException.asConnException(RdbmsException.java:36) ~[plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.rdbms.util.DBUtil.connect(DBUtil.java:397) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.rdbms.util.DBUtil.connect(DBUtil.java:387) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.rdbms.util.DBUtil.access$000(DBUtil.java:22) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.rdbms.util.DBUtil$3.call(DBUtil.java:322) ~[plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.rdbms.util.DBUtil$3.call(DBUtil.java:319) ~[plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.common.util.RetryUtil$Retry.call(RetryUtil.java:164) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.common.util.RetryUtil$Retry.doRetry(RetryUtil.java:111) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.common.util.RetryUtil.executeWithRetry(RetryUtil.java:30) [datax-common-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:319) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:303) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.oceanbasev10writer.util.DbUtils.fetchSingleValueWithRetry(DbUtils.java:50) [oceanbasev10writer-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.checkCompatibleMode(OceanBaseV10Writer.java:196) [oceanbasev10writer-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.init(OceanBaseV10Writer.java:61) [oceanbasev10writer-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.job.JobContainer.initJobWriter(JobContainer.java:704) [datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.job.JobContainer.init(JobContainer.java:304) [datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:113) [datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.Engine.start(Engine.java:93) [datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.Engine.entry(Engine.java:175) [datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.Engine.main(Engine.java:208) [datax-core-0.0.1-SNAPSHOT.jar:na]
2023-03-22 04:11:15.483 [job-0] ERROR RetryUtil - Exception when calling callable, 即将尝试执行第1次重试.本次重试计划等待[1000]ms,实际等待[1000]ms, 异常Msg:[Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).]. - 具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]]
2023-03-22 04:11:17.485 [job-0] ERROR RetryUtil - Exception when calling callable, 即将尝试执行第2次重试.本次重试计划等待[2000]ms,实际等待[2000]ms, 异常Msg:[Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).]. - 具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]]
2023-03-22 04:11:21.486 [job-0] ERROR RetryUtil - Exception when calling callable, 即将尝试执行第3次重试.本次重试计划等待[4000]ms,实际等待[4000]ms, 异常Msg:[Code:[DBUtilErrorCode-10], Description:[连接数据库失败. 请检查您的 账号、密码、数据库名称、IP、Port或者向 DBA 寻求帮助(注意网络环境).]. - 具体错误信息为:java.sql.SQLException: No suitable driver found for ["||_dsc_ob10_dsc_||test:testtenant||_dsc_ob10_dsc_||jdbc:oceanbase://127.0.0.1:2883/testtest"]]
^C[Error] DataX receive unexpected signal 2, starts to suicide.
2023-03-22 16:11:25
Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.202-b08 mixed mode):
"SIGINT handler" #12 daemon prio=9 os_prio=0 tid=0x00007fa478001000 nid=0x1e21 runnable [0x00007fa49b147000]
java.lang.Thread.State: RUNNABLE
at java.lang.Thread.run(Thread.java:747)
"Abandoned connection cleanup thread" #11 daemon prio=5 os_prio=0 tid=0x00007fa4c084b000 nid=0x1de3 in Object.wait() [0x00007fa49b249000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000ed3a53f0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
- locked <0x00000000ed3a53f0> (a java.lang.ref.ReferenceQueue$Lock)
at com.alipay.oceanbase.jdbc.AbandonedConnectionCleanupThread.run(AbandonedConnectionCleanupThread.java:43)
"Abandoned connection cleanup thread" #10 daemon prio=5 os_prio=0 tid=0x00007fa4c064d000 nid=0x1de2 in Object.wait() [0x00007fa4a8147000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000ec5bf560> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
- locked <0x00000000ec5bf560> (a java.lang.ref.ReferenceQueue$Lock)
at com.mysql.jdbc.AbandonedConnectionCleanupThread.run(AbandonedConnectionCleanupThread.java:64)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
"Service Thread" #9 daemon prio=9 os_prio=0 tid=0x00007fa4c00e6000 nid=0x1dd4 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C1 CompilerThread3" #8 daemon prio=9 os_prio=0 tid=0x00007fa4c00c9000 nid=0x1dd3 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007fa4c00c6800 nid=0x1dd2 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007fa4c00c4800 nid=0x1dd1 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007fa4c00c1800 nid=0x1dd0 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007fa4c00c0000 nid=0x1dcf waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007fa4c008d000 nid=0x1dce in Object.wait() [0x00007fa4b04f3000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000eab08ed0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
- locked <0x00000000eab08ed0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)
"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007fa4c008a800 nid=0x1dcd in Object.wait() [0x00007fa4b05f4000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000eab06bf8> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:502)
at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
- locked <0x00000000eab06bf8> (a java.lang.ref.Reference$Lock)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
"job-0" #1 prio=5 os_prio=0 tid=0x00007fa4c000a800 nid=0x1dc3 waiting on condition [0x00007fa4c9868000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at com.alibaba.datax.common.util.RetryUtil$Retry.doRetry(RetryUtil.java:148)
at com.alibaba.datax.common.util.RetryUtil.executeWithRetry(RetryUtil.java:30)
at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:319)
at com.alibaba.datax.plugin.rdbms.util.DBUtil.getConnection(DBUtil.java:303)
at com.alibaba.datax.plugin.writer.oceanbasev10writer.util.DbUtils.fetchSingleValueWithRetry(DbUtils.java:50)
at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.checkCompatibleMode(OceanBaseV10Writer.java:196)
at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Job.init(OceanBaseV10Writer.java:61)
at com.alibaba.datax.core.job.JobContainer.initJobWriter(JobContainer.java:704)
at com.alibaba.datax.core.job.JobContainer.init(JobContainer.java:304)
at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:113)
at com.alibaba.datax.core.Engine.start(Engine.java:93)
at com.alibaba.datax.core.Engine.entry(Engine.java:175)
at com.alibaba.datax.core.Engine.main(Engine.java:208)
"VM Thread" os_prio=0 tid=0x00007fa4c0081000 nid=0x1dcc runnable
"GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007fa4c001f800 nid=0x1dc4 runnable
"GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007fa4c0021800 nid=0x1dc5 runnable
"GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007fa4c0023000 nid=0x1dc6 runnable
"GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007fa4c0025000 nid=0x1dc7 runnable
"GC task thread#4 (ParallelGC)" os_prio=0 tid=0x00007fa4c0027000 nid=0x1dc8 runnable
"GC task thread#5 (ParallelGC)" os_prio=0 tid=0x00007fa4c0028800 nid=0x1dc9 runnable
"GC task thread#6 (ParallelGC)" os_prio=0 tid=0x00007fa4c002a800 nid=0x1dca runnable
"GC task thread#7 (ParallelGC)" os_prio=0 tid=0x00007fa4c002c800 nid=0x1dcb runnable
"VM Periodic Task Thread" os_prio=0 tid=0x00007fa4c00e9000 nid=0x1dd5 waiting on condition
JNI global references: 314
Heap
PSYoungGen total 305664K, used 57719K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
eden space 262144K, 22% used [0x00000000eab00000,0x00000000ee35dcb0,0x00000000fab00000)
from space 43520K, 0% used [0x00000000fd580000,0x00000000fd580000,0x0000000100000000)
to space 43520K, 0% used [0x00000000fab00000,0x00000000fab00000,0x00000000fd580000)
ParOldGen total 699392K, used 0K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
object space 699392K, 0% used [0x00000000c0000000,0x00000000c0000000,0x00000000eab00000)
Metaspace used 13520K, capacity 13836K, committed 13952K, reserved 1060864K
class space used 1485K, capacity 1612K, committed 1664K, reserved 1048576K
DataX Process was killed ! you did ?
[root@cui-work0 datax]#