search

bpot / poseidon

A client for Kafka 0.8
MIT License
260 stars 101 forks source link

Logging? #97

Open rayjohnson opened 9 years ago

rayjohnson commented 9 years ago

Is there a way to turn on additional logging or anything?

I created a producer that appears to connect - in fact, I see the topics get created. The result of "@producer.send_messages" returns true. However, no message appears to get sent.

(Well - kafka-avro-console-consumer tells me it consumed 0 messages. I'm new to kafka and am almost certainly doing something silly.)

In any case, I'm hoping there is a way to turn on some level of extended logging to determine what is not right...

Ray

michaeldauria commented 9 years ago

You should check the lag and logSize of your topic with a command like this:

kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --zookeeper 127.0.0.1:2181 --group $CONSUMER_GROUP --topic $TOPIC

Output:

Group           Topic                          Pid Offset          logSize         Lag             Owner
consumer_group  topic                          0   727545          727545          0               consumer-id-here