search

cloudstax / firecamp

Serverless Platform for the stateful services
https://www.cloudstax.io
Apache License 2.0
209 stars 20 forks source link

Kafka logs flooding #10

Closed jazzl0ver closed 6 years ago

jazzl0ver commented 6 years ago

Hi. Found a lot of such messages in the logs (CloudWatch):

[2017-11-29 22:43:58,934] INFO [GroupMetadataManager brokerId=2] Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.group.GroupMetadataManager)

Is there an option to stop flooding like this?

JuniusLuo commented 6 years ago

Could you please post more logs? How often the messages are logged? like every second?

jazzl0ver commented 6 years ago

Every 10 minutes: image

JuniusLuo commented 6 years ago

Thanks for posting the detail logs! This looks ok. It is only logged 1 message every 10 minutes. This would be the expected behaviour of Kafka.

If you still have concern about it, it would be better to ask Kafka guys :)

jazzl0ver commented 6 years ago

Thank you, @JuniusLuo !