DataX导出报错,请教一下怎么排除,有部分数据进去了,有部分失败了

2021-05-07 11:47:56.812 [job-0] INFO MetricReportUtil - reportJobMetric is turn off

2021-05-07 11:47:56.813 [job-0] INFO StandAloneJobContainerCommunicator - Total 29705536 records, 1906066480 bytes | Speed 813.40KB/s, 13001 records/s | Error 5512 records, 353629 bytes | All Task WaitWriterTime 3,992.383s | All Task WaitReaderTime 198.239s | Percentage 0.00%

2021-05-07 11:48:06.814 [job-0] INFO MetricReportUtil - reportJobMetric is turn off

2021-05-07 11:48:06.814 [job-0] INFO StandAloneJobContainerCommunicator - Total 29830528 records, 1914091159 bytes | Speed 783.66KB/s, 12499 records/s | Error 5512 records, 353629 bytes | All Task WaitWriterTime 4,000.303s | All Task WaitReaderTime 198.972s | Percentage 0.00%

2021-05-07 11:48:14.535 [0-0-0-writer] INFO CommonRdbmsWriter$Task - isMemstoreFull=false

2021-05-07 11:48:16.816 [job-0] INFO MetricReportUtil - reportJobMetric is turn off

2021-05-07 11:48:16.816 [job-0] INFO StandAloneJobContainerCommunicator - Total 29951904 records, 1921863532 bytes | Speed 759.02KB/s, 12137 records/s | Error 5512 records, 353629 bytes | All Task WaitWriterTime 4,008.199s | All Task WaitReaderTime 199.782s | Percentage 0.00%

2021-05-07 11:48:26.817 [job-0] INFO MetricReportUtil - reportJobMetric is turn off

2021-05-07 11:48:26.817 [job-0] INFO StandAloneJobContainerCommunicator - Total 30074848 records, 1929733907 bytes | Speed 768.59KB/s, 12294 records/s | Error 5512 records, 353629 bytes | All Task WaitWriterTime 4,015.975s | All Task WaitReaderTime 200.537s | Percentage 0.00%

任务总计耗时 : 18628s

读出记录总数 : 125332548

读写失败总数 : 36908

把错误的记录手动插入一条到目标库,看看是否能插入成功?

源数据库是什么呢,目标库是ob的那种模式for oracle or mysql?为什么都提示5512条记录错误?


目标库是OB 的Oracle租户,错误的记录怎么看?

1 个赞

把datax的日志贴全,应该可以看到关于失败的数据的报错,比如duplicate key等

看看datax的日志文件里有没有,没有的话? 将插入成功的记录除排就是错误记录了(一个 not in 操作)