provectus / kafka-ui

Open-Source Web UI for Apache Kafka Management
Apache License 2.0
9.51k stars 1.16k forks source link

Kafka Stream Topology visualizer #205

Open IldarAlmakaev opened 3 years ago

IldarAlmakaev commented 3 years ago

As a user, I would like to copy&paste a generated Kafka Streams topology from an application log and then generate a nice-looking diagram in Kafka UI application. It would help users to review how their stream topology is built. As an example, you can take a look at this repo. example

We can implement a parser of this topology in the backend and then provide models for easier display in UI

Here we could add features like:

The data model is a graph that consists of source connectors, sink connectors, and consumers. Consumers are processor topologies that consist of stream processors (nodes) that are connected by streams (edges). The graph nodes have additional info:

AndreasKlein commented 11 months ago

Hi everyone, what is the current status of this? Has someone started implementing it already? If not, since it would be a very helpful feature for our teams, is there a way we can help?

Haarolean commented 11 months ago

@AndreasKlein https://github.com/provectus/kafka-ui/discussions/4255