Hello
we have configured flume-ng-sql-source 1.5.3 in cloudera cluster 5.15 with flume 1.6.0.
we have configured a kafka channel and a hdfs sink.
We need read a complete oracle table with 2000 records with an interval of 30 seconds.
When we start the flume agent it start the agent it read the one time the 2000 records and sink it to hdfs file, but after 30 seconds it give us the error:
SQLSource | Error procesing row java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.keedio.flume.source.SQLSource.process(SQLSource.java:116) at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:133) at java.lang.Thread.run(Thread.java:748)
Stopping sql source sqlsource ...
12:55:59.379 | INFO | HibernateHelper | Closing hibernate session
and don't read any more records.
we have configured the parameters
agent.sources.sqlsource.table = tabl1
agent.sources.sqlsource.columns.to.select = sysdate, field1, field2, field3
agent.sources.sqlsource.hibernate.dialect = org.hibernate.dialect.OracleDialect
agent.sources.sqlsource.hibernate.connection.driver_class = oracle.jdbc.OracleDriver
Hello we have configured flume-ng-sql-source 1.5.3 in cloudera cluster 5.15 with flume 1.6.0. we have configured a kafka channel and a hdfs sink. We need read a complete oracle table with 2000 records with an interval of 30 seconds. When we start the flume agent it start the agent it read the one time the 2000 records and sink it to hdfs file, but after 30 seconds it give us the error:
SQLSource | Error procesing row java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.keedio.flume.source.SQLSource.process(SQLSource.java:116) at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:133) at java.lang.Thread.run(Thread.java:748)
Stopping sql source sqlsource ...
12:55:59.379 | INFO | HibernateHelper | Closing hibernate session
and don't read any more records.
we have configured the parameters agent.sources.sqlsource.table = tabl1 agent.sources.sqlsource.columns.to.select = sysdate, field1, field2, field3 agent.sources.sqlsource.hibernate.dialect = org.hibernate.dialect.OracleDialect agent.sources.sqlsource.hibernate.connection.driver_class = oracle.jdbc.OracleDriver
Thanks in advance for your help best regards