ukwa / ukwa-services

Deployment configuration for all UKWA services stacks.
Apache License 2.0
4 stars 5 forks source link

Upgrade FC Crawler Kafka #87

Open anjackson opened 2 years ago

anjackson commented 2 years ago

Every so often the Kafka-LogStash-ElasticSearch process dies with a Kafka data integrity error, which disappears when LogStash is restarted.

The only thing I can think of doing is updating Kafka itself in the hope of it being a bug, and maybe reviewing and sync to disk settings.