search

keedio / flume-ng-sql-source

Flume Source to import data from SQL Databases
Apache License 2.0
264 stars 164 forks source link

Problem sleep interrupted java.lang.Thread.sleep(Native Method) #81

Open dmet6789 opened 5 years ago

dmet6789 commented 5 years ago

Hello we have configured flume-ng-sql-source 1.5.3 in cloudera cluster 5.15 with flume 1.6.0. we have configured a kafka channel and a hdfs sink. We need read a complete oracle table with 2000 records with an interval of 30 seconds. When we start the flume agent it start the agent it read the one time the 2000 records and sink it to hdfs file, but after 30 seconds it give us the error:

SQLSource | Error procesing row java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.keedio.flume.source.SQLSource.process(SQLSource.java:116) at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:133) at java.lang.Thread.run(Thread.java:748)

Stopping sql source sqlsource ...

12:55:59.379 | INFO | HibernateHelper | Closing hibernate session

and don't read any more records.

we have configured the parameters agent.sources.sqlsource.table = tabl1 agent.sources.sqlsource.columns.to.select = sysdate, field1, field2, field3 agent.sources.sqlsource.hibernate.dialect = org.hibernate.dialect.OracleDialect agent.sources.sqlsource.hibernate.connection.driver_class = oracle.jdbc.OracleDriver

Thanks in advance for your help best regards