anshmehtamm / RippleMQ

A simple distributed messaging queue system inspired by Kafka which uses Apache Ratis for consensus. (In development)
0 stars 0 forks source link

Metadata log for each broker with replication #1

Open anshmehtamm opened 1 week ago

anshmehtamm commented 1 week ago
  1. Each broker has its own information and it's peers
  2. When starting it connects with other brokers
  3. Form a active broker metadata log.
  4. Addition and deletion done on metadata log which is replicated.

Metadata log contains

  1. Active brokers
  2. Topics and partition they're leader for
  3. Partition's they'll replicate.
anshmehtamm commented 5 days ago

{ "brokers": [{"brokerId":1, "hostname": "b1"}, {}] "leaderId" : 1 "topics": {"topic_name":A, partitions: [{"id", "leaderId", "replicationId", offset:""}, {} }