search

DTStack / chunjun

A data integration framework
https://dtstack.github.io/chunjun/
Apache License 2.0
4.01k stars 1.69k forks source link

达蒙数据同步到hdfs效率很低 #1917

Open wushangqiao1 opened 3 months ago

wushangqiao1 commented 3 months ago

Search before asking

Description

dm数据表有3kw数据量，同步到hdfs效率很低

Code of Conduct

wushangqiao1 commented 3 months ago

看代码，mysql和dm都是用的jdbc connector, dm的怎么这么慢呢

baisui1981 commented 1 month ago

dm数据表有3kw数据量，同步到hdfs效率很低

为啥不试试 dataX 这样的工具