search

rotationalio / baleen

An automated ingestion service of RSS feeds to construct a corpus for NLP research.
https://ensign.rotational.dev/examples/data_scientists/
GNU Affero General Public License v3.0
9 stars 3 forks source link

Add Docker Kafka and Zookeeper #31

Closed pdeziel closed 2 years ago

pdeziel commented 2 years ago

This adds a single node, multi-broker docker compose Kafka configuration. If we want to go this route (rather than using a fully managed Kafka service), we will probably want to split this up onto multiple nodes for true replication and so that all the brokers aren't using the same disk and network.

shortcut-integration[bot] commented 2 years ago

This pull request has been linked to Shortcut Story #3321: Dockerize Kafka.