Open snowice opened 10 years ago
hello :)
you may need to jar packaging job. i wrote that how to kafka plugin on my blog. language is korean. sorry
but attched image. if you see following image on myblog, more help for you
2013/11/22 snowice notifications@github.com
First, thanks for your plugin, I send logs from flume to kafka success. But,when i start flume ,there are some WARN messages. I‘m not farmiliar with JAVA,please don't laugh at me. -_-
My flume-sink configuration: a1.sinks.k1.type = org.apache.flume.plugins.KafkaSink a1.sinks.k1.channel = c1 a1.sinks.k1.metadata.broker.list = 192.168.165.39:9092,192.168.165.53:9092 a1.sinks.k1.custom.topic.name = maillog a1.sinks.k1.serializer.class = kafka.serializer.StringEncoder a1.sinks.k1.request.required.acks = 0 a1.sinks.k1.producer.type = sync a1.sinks.k1.request.required.acks = 0
WARN message: 2013-11-22 00:01:30,076 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Verifying properties 2013-11-22 00:01:30,103 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property metadata.broker.list is overridden to 192.168.165.39:9092, 192.168.165.53:9092 2013-11-22 00:01:30,104 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property custom.topic.name is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property request.required.acks is overridden to 0 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property type is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property serializer.class is overridden to kafka.serializer.StringEncoder 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property channel is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property producer.type is overridden to sync
— Reply to this email directly or view it on GitHubhttps://github.com/beyondj2ee/flumeng-kafka-plugin/issues/1 .
Your blog URL is ? "https://github.com/beyondj2ee/flume-window " ?
In my flume-ng lib dir, I have added following jar files that downloaded from your repositories
-rw-r--r-- 1 root root 2525701 Nov 21 23:52 kafka_2.9.2-0.8.0-beta1.jar -rw-r--r-- 1 root root 11077 Nov 21 23:17 flumeng-kafka-plugin.jar -rw-r--r-- 1 root root 4229 Nov 21 23:17 metrics-annotation-2.2.0.jar -rw-r--r-- 1 root root 82123 Nov 21 23:17 metrics-core-2.2.0.jar -rw-r--r-- 1 root root 11449543 Nov 21 23:17 scala-compiler-2.9.2.jar -rw-r--r-- 1 root root 8857794 Nov 21 23:17 scala-library-2.9.2.jar -rw-r--r-- 1 root root 62913 Nov 21 23:17 zkclient-0.1.jar
First, thanks for your plugin, I send logs from flume to kafka success. But,when i start flume ,there are some WARN messages. I‘m not farmiliar with JAVA,please don't laugh at me. -_-
My flume-sink configuration: a1.sinks.k1.type = org.apache.flume.plugins.KafkaSink a1.sinks.k1.channel = c1 a1.sinks.k1.metadata.broker.list = 192.168.165.39:9092,192.168.165.53:9092 a1.sinks.k1.custom.topic.name = maillog a1.sinks.k1.serializer.class = kafka.serializer.StringEncoder a1.sinks.k1.request.required.acks = 0 a1.sinks.k1.producer.type = sync a1.sinks.k1.request.required.acks = 0
WARN message: 2013-11-22 00:01:30,076 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Verifying properties 2013-11-22 00:01:30,103 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property metadata.broker.list is overridden to 192.168.165.39:9092,192.168.165.53:9092 2013-11-22 00:01:30,104 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property custom.topic.name is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property request.required.acks is overridden to 0 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property type is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property serializer.class is overridden to kafka.serializer.StringEncoder 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property channel is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property producer.type is overridden to sync