toni-moreno / syncflux

SyncFlux is an Open Source InfluxDB Data synchronization and replication tool for migration purposes or HA clusters
MIT License
154 stars 34 forks source link

Gaps after sync using ha-monitor #55

Open mzacchi opened 2 years ago

mzacchi commented 2 years ago

Hi syncflux guys,

Thanks for this extremely useful piece of software. I have a setup with master and slave Influx DBs, using syncflux to sync them. The problem I am facing is that, after the initial sync is completed ("msg="Processed Chunk 1590/17473 from [16...." reaches 100%), there is a gap in the newest portion of the DB, that only gets filled when I restart the service. Is that the usual behavior or am I missing something in the configuration?

This is the command that the service runs: /usr/sbin/syncflux -config=/etc/syncflux/syncflux.toml -logs=/var/log/syncflux -action hamonitor -chunk 30m -master influxdb-1 -slave influxdb-2

And this is the .toml file:

[General]
logdir = "./log"
loglevel = "info"
 sync-mode = "onlyslave"

master-db = "influxdb-1"

slave-db = "influxdb-2"

check-interval = "10s"
min-sync-interval = "20s"

initial-replication = "both"
monitor-retry-interval = "1m"
data-chuck-duration = "20m"

rw-max-retries = 5

 rw-retry-delay = "10s"
num-workers = 6
max-points-on-single-write = 10000
[http]
 name = "influx-sync"
 bind-addr = "10.1.1.14:4090"
 admin-user = "admin"
 admin-passwd = "passwd"
 cookie-id = "mycookie"
[[influxdb]]
 release = "1x"
 name = "influxdb-1"
 location = "http://10.1.1.15:8086/"
 admin-user = "librenms"
 admin-passwd = "passwd"
 timeout = "60s"
[[influxdb]]
 release = "1x"
 name = "influxdb-2"
 location = "http://10.1.1.14:8086/"
 admin-user = "influxsync"
 admin-passwd = "passwd"
 timeout = "60s"

Thanks