Document minimal confluent kafka software setup

Clinical-Genomics / event-driven-architecture

Project tracking for event driven POC

0 stars 0 forks source link

Document minimal confluent kafka software setup #7

Closed seallard closed 4 weeks ago

seallard commented 1 month ago

Document the minimal setup with confluent kafka required to implement a basic pub/sub pattern.

seallard commented 1 month ago

The following components are required

Component	Service Description	Default Port	Internal Only?
Kafka Broker	Interbroker listener	9091	Yes
	External listener	9092	No
	Confluent Server REST API	8090	No
	Jolokia	7771	No
KRaft Controller	peer-to-peer communication	9093	Yes

The following components are nice to have

Component	Default Port	Internal Only?
Confluent Control Center	9021	No
(Standalone) REST Proxy	8082	No
Metadata Service (MDS)	8090	No

seallard commented 1 month ago

Seems like there is an initiative to deprecate ZooKeeper, not sure what the status is yet. kip-500.

EDIT: Seems like KRaft replaces ZooKeeper and is preferable. See article. Also what is recommended in Confluents on-prem setup guide here, ZooKeeper is deprecated.