bakdata / kafka-key-value-store

Queryable Kafka Topics with Kafka Streams.
https://medium.com/bakdata/queryable-kafka-topics-with-kafka-streams-8d2cca9de33f
MIT License
24 stars 12 forks source link

Queryable Kafka Topics with Kafka Streams

This repository provides the source code for our blog post on Medium.

It includes an example implementation of a Kafka Streams application that provides a key-value query interface to the messages of a key-partitioned Kafka topic.

Additionally, a Dockerfile and a Kubernetes deployment specification demonstrate how the application can be easily deployed to a Kubernetes Cluster.

Quick Start

Compile the project using Maven:

mvn package

Start one or more instances of the Kafka Streams application:

./streams-processor                         \
    --topic messages                        \
    --streams-props                         \
        bootstrap.servers=localhost:9092    \
        num.standby.replicas=1              \
    --application-id my-streams-processor   \
    --hostname localhost