beyondj2ee
commented
10 years ago hello :)
you may need to jar packaging job. i wrote that how to kafka plugin on my blog. language is korean. sorry
but attched image. if you see following image on myblog, more help for you
2013/11/22 snowice notifications@github.com
First, thanks for your plugin, I send logs from flume to kafka success. But,when i start flume ,there are some WARN messages. I‘m not farmiliar with JAVA,please don't laugh at me. -_-
My flume-sink configuration: a1.sinks.k1.type = org.apache.flume.plugins.KafkaSink a1.sinks.k1.channel = c1 a1.sinks.k1.metadata.broker.list = 192.168.165.39:9092,192.168.165.53:9092 a1.sinks.k1.custom.topic.name = maillog a1.sinks.k1.serializer.class = kafka.serializer.StringEncoder a1.sinks.k1.request.required.acks = 0 a1.sinks.k1.producer.type = sync a1.sinks.k1.request.required.acks = 0
WARN message: 2013-11-22 00:01:30,076 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Verifying properties 2013-11-22 00:01:30,103 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property metadata.broker.list is overridden to 192.168.165.39:9092, 192.168.165.53:9092 2013-11-22 00:01:30,104 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property custom.topic.name is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property request.required.acks is overridden to 0 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property type is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property serializer.class is overridden to kafka.serializer.StringEncoder 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property channel is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property producer.type is overridden to sync
— Reply to this email directly or view it on GitHubhttps://github.com/beyondj2ee/flumeng-kafka-plugin/issues/1 .
snowice
First, thanks for your plugin, I send logs from flume to kafka success. But,when i start flume ,there are some WARN messages. I‘m not farmiliar with JAVA,please don't laugh at me. -_-
My flume-sink configuration: a1.sinks.k1.type = org.apache.flume.plugins.KafkaSink a1.sinks.k1.channel = c1 a1.sinks.k1.metadata.broker.list = 192.168.165.39:9092,192.168.165.53:9092 a1.sinks.k1.custom.topic.name = maillog a1.sinks.k1.serializer.class = kafka.serializer.StringEncoder a1.sinks.k1.request.required.acks = 0 a1.sinks.k1.producer.type = sync a1.sinks.k1.request.required.acks = 0
WARN message: 2013-11-22 00:01:30,076 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Verifying properties 2013-11-22 00:01:30,103 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property metadata.broker.list is overridden to 192.168.165.39:9092,192.168.165.53:9092 2013-11-22 00:01:30,104 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property custom.topic.name is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property request.required.acks is overridden to 0 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property type is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property serializer.class is overridden to kafka.serializer.StringEncoder 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [WARN - kafka.utils.Logging$class.warn(Logging.scala:82)] Property channel is not valid 2013-11-22 00:01:30,105 (lifecycleSupervisor-1-3) [INFO - kafka.utils.Logging$class.info(Logging.scala:67)] Property producer.type is overridden to sync