使用此插件连接采集oracle数据时，刚开始采集正常，一段时间后程序卡着不动了，也没有报什么错误

keedio / flume-ng-sql-source

Flume Source to import data from SQL Databases

Apache License 2.0

264 stars 164 forks source link

使用此插件连接采集oracle数据时，刚开始采集正常，一段时间后程序卡着不动了，也没有报什么错误 #71

Open summyer opened 5 years ago

summyer commented 5 years ago

改了部分代码，使其通过json字符串发送到kafka中 for(Map row:result){ String body=new Gson().toJson(row); pw.write(body+"\n"); }

lucarosellini commented 5 years ago

Hi @summyer, could you please explain your issue in English?

Thanks

summyer commented 5 years ago

ok,

When using this plugin to collect oracle data, it just started to collect normally. After a while, the program stops collecting, and no error is reported, but the process is still there; I changed some of the code to use json string when pushing to kafka.

lazaromedina commented 5 years ago

Hi summyer, try setting debug or trace mode when launching flume agent. Try dumping data to file_roll, for discarding flume-sink. As you say there is no error reported, so it is hard to help. Also keep in mind that you changed code base, so anything can happen. best