HomeAdvisor / Kafdrop

Kafka UI and Monitoring Tool
Apache License 2.0
399 stars 163 forks source link

Viewing Avro-serialized JSON messages #15

Open GHGautamGH opened 7 years ago

GHGautamGH commented 7 years ago

Hi,

My Kafka topics contain Avro-serialized JSON messages and I cannot view those correctly now. Is there a way-out?

Also it would be nice to know whether the following features are available or in roadmap -- 1) Viewing the number of messages for individual topics on the Home Page (Cluster Overview page) 2) Periodic auto-refresh of the home page 3) Any plans to include monitoring of Kafka-connect workers/tasks

Thanks in advance.

Gautam Ghosh

JNLevin commented 6 years ago

I have a fork that adds Schema Registry integration for parsing Avro. Are people interested in this still?

paulbandler commented 6 years ago

Yes, I had assumed that viewing of Avro encoded messages would be possible so disappointed that it's not.

chaisha commented 6 years ago

does kafdrop work with kafka 0.9 and above where offsets are maintained in a separate topic. When I try with kafka 0.9 or above I see not all consumers are fetched.

JNLevin commented 6 years ago

If I can get permission to create/update a branch I'll push these changes.I

lcary commented 6 years ago

I was also interested in this feature, but I couldn't find @JNLevin's fork. So here's a pull request with my changes to enable viewing of Avro-serialized messages in case anyone here wants a starting point: https://github.com/HomeAdvisor/Kafdrop/pull/33