keedio / flume-ng-sql-source

Flume Source to import data from SQL Databases
Apache License 2.0
264 stars 164 forks source link

there is nothing in my flume console #52

Closed vinnielhj closed 6 years ago

vinnielhj commented 6 years ago

Hi,I use this source like this:

mysql-logger-agent.sources.mysql-source.type = org.keedio.flume.source.SQLSource
mysql-logger-agent.sources.mysql-source.hibernate.connection.url = jdbc:mysql://localhost:3306/test
mysql-logger-agent.sources.mysql-source.hibernate.connection.user = root
mysql-logger-agent.sources.mysql-source.hibernate.connection.password = root
mysql-logger-agent.sources.mysql-source.connection.autocommit = true
mysql-logger-agent.sources.mysql-source.hibernate.dialect = org.hibernate.dialect.MySQLDialect
mysql-logger-agent.sources.mysql-source.hibernate.connection.driver_class = com.mysql.jdbc.Driver
mysql-logger-agent.sources.mysql-source.start.from = 0
mysql-logger-agent.sources.mysql-source.batch.size = 2
mysql-logger-agent.sources.mysql-source.max.rows = 2
mysql-logger-agent.sources.mysql-source.custom.query = SELECT id,name from tb WHERE id > $@$ order by id asc
mysql-logger-agent.sources.mysql-source.run.query.delay = 5000
mysql-logger-agent.sources.mysql-source.status.file.path = ~/data/mysql_flume
mysql-logger-agent.sources.mysql-source.status.file.name = sqlSource.status
mysql-logger-agent.sources.mysql-source.hibernate.connection.provider_class = org.hibernate.connection.C3P0ConnectionProvider
mysql-logger-agent.sources.mysql-source.hibernate.c3p0.min_size=1
mysql-logger-agent.sources.mysql-source.hibernate.c3p0.max_size=10

# Use a channel which buffers events in memory
mysql-logger-agent.channels.mysql-memory-channel.type = memory

# Describe the sink
mysql-logger-agent.sinks.logger-sink.type = logger

# Bind the source and sink to the channel
mysql-logger-agent.sources.mysql-source.channels = mysql-memory-channel
mysql-logger-agent.sinks.logger-sink.channel = mysql-memory-channel

when i insert 1 or some record into table,there is nothing in my flume console,could you please help me?thank you!!! my mysql table only have 2 clumn,id and name.

lazaromedina commented 6 years ago

Hi lhjzmn,

best, Luis

vinnielhj commented 6 years ago

I have resoved it,Thanks!