search

zendesk / maxwell

Maxwell's daemon, a mysql-to-json kafka producer
https://maxwells-daemon.io/
Other
4.04k stars 1.01k forks source link

Want to run HA on 3 different host #2027

Open shwetadesai-tgs opened 1 year ago

shwetadesai-tgs commented 1 year ago

I am using Maxwell 1.40.2 and MySQL 8.0.31. I am running Maxwell in Ubuntu through the Windows WSL feature. I use RabbitMQ as a producer. Issue: I want to run each raft of Maxwell HA on 3 separate host

Replica_host is the same for all: 192.168.1.25

Like raft_id=A on 192.168.1.11 raft_id=B on 192.168.1.12 raft_id=C on 192.168.1.13

When I run maxwell all the above, they all run as individual maxwell services.

osheroff commented 1 year ago

what does your raft.xml look like? are you passing --ha? please include any logs relevant to your issue.

shwetadesai-tgs commented 1 year ago

bin/maxwell --config /mnt/d/maxwell-1.40.2/config/config.properties --ha --raft_member_id=A

using above command at ubuntu prompt in WSL

osheroff commented 1 year ago

post logs plz

huiji121 commented 1 year ago

I want to implement maxwell's HA. What are the complete steps

shwetadesai-tgs commented 1 year ago

We are not maitaining raft.xml. Just configured HA using command as metioned below bin/maxwell --config /mnt/d/maxwell-1.40.2/config/config.properties --ha --raft_member_id=A

Also, we are not maintaining any logs. For your reference attaching SS after executing command on 2 different host but Reading MySQL binlog of 1,

Screenshot_