search

keedio / flume-ng-sql-source

Flume Source to import data from SQL Databases
Apache License 2.0
264 stars 164 forks source link

Can't get data from Mysql #34

Closed GeorgeGuoCN closed 7 years ago

GeorgeGuoCN commented 7 years ago

When I get data from Mysql, the Custom query: agent.sources.sqlSource.start.from = 20170801000000 agent.sources.sqlSource.custom.query = SELECT * FROM order WHERE PAY_TIME > $@$ ORDER BY PAY_TIME ASC

Error log: 2017-08-01 19:16:56,435 (PollableSourceRunner-SQLSource-sqlSource) [WARN - org.hibernate.engine.jdbc.spi.SqlExceptionHelper$StandardWarningHandler.logWarning(SqlExceptionHelper.java:233)] Incorrect datetime value: '6939' for column 'PAY_TIME' at row 1 Exception in thread "PollableSourceRunner-SQLSource-sqlSource" java.lang.AbstractMethodError: org.keedio.flume.source.SQLSource.getMaxBackOffSleepInterval(),

software version: Mysql:5.6.16 JDK:1.8 flume:1.7.0

lufeng1102 commented 7 years ago

It seems like a data type issue from 'PAY_TIME‘ field.

mvalleavila commented 7 years ago

Hello,

As lufen commented it seem that the error is related with data types.

The value of PAY_TIME isn't a valid datetime, and the comparison with 20170801000000 can't be done. (Incorrect datetime value: '6939')

Maybe PAY_TIME column is an int or double (a time period?)

skt0001 commented 6 years ago

Hi, I am getting an error while reading logs from rabbitmq to HDFS path using Flume.

Please can somebody help me to rectify the issue.

Exception in thread "PollableSourceRunner-RabbitMQSource-rabbitmq-source1" java.lang.AbstractMethodError: org.apache.flume.source.rabbitmq.RabbitMQSource.getBackOffSleepIncrement()J at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:142) at java.lang.Thread.run(Thread.java:748)