frankyaorenjie / flume-kafka

A kafka source & sink for flume
72 stars 53 forks source link

org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:149 #13

Closed wayne666 closed 10 years ago

wayne666 commented 10 years ago

Error info: 2014-08-20 18:55:51,755 (conf-file-poller-0) [ERROR - org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:149)] Unhandled error java.lang.NoSuchMethodError: scala.math.LowPriorityOrderingImplicits.ordered()Lscala/math/Ordering; at kafka.producer.ZKBrokerPartitionInfo$$anonfun$kafka$producer$ZKBrokerPartitionInfo$$getZKTopicPartitionInfo$1.apply(ZKBrokerPartitionInfo.scala:172) at kafka.producer.ZKBrokerPartitionInfo$$anonfun$kafka$producer$ZKBrokerPartitionInfo$$getZKTopicPartitionInfo$1.apply(ZKBrokerPartitionInfo.scala:163)

I use the kafka sink functionality, kafka-0.7.2.jar and flume-kafka-0.2.jar in flume lib path, kafka version is 0.7.2,flume version is 1.5.0

flume configuration: agent_log.sources = r1 agent_log.sinks = kafka agent_log.channels = c1

agent_log.sources.r1.type = exec agent_log.sources.r1.channels = c1 agent_log.sources.r1.command = tail -f /var/log/test.log

agent_log.channels.c1.type = memory agent_log.channels.c1.capacity = 1000 agent_log.channels.c1.trasactionCapacity = 100

agent_log.sinks.kafka.type = com.vipshop.flume.sink.kafka.KafkaSink agent_log.sinks.kafka.channel = c1 agent_log.sinks.kafka.zk.connect = kafkaNode:2181 agent_log.sinks.kafka.topic = my-replicated-topic agent_log.sinks.kafka.batchsize = 200 agent_log.sinks.kafka.producer.type = async agent_log.sinks.kafka.serializer.class = kafka.serializer.StringEncoder

wayne666 commented 10 years ago

Due to i have tow versions of the scala-library, so i delete one of them, everything seems ok

frankyaorenjie commented 10 years ago

okay. :)