CPU Usage is bursting when stream of logs

gliderlabs / logspout

Log routing for Docker container logs

MIT License

4.66k stars 680 forks source link

CPU Usage is bursting when stream of logs #388

Open Dean-Christian-Armada opened 6 years ago

Dean-Christian-Armada commented 6 years ago

We have an nginx container that accepts hundreds of request per second and logspout is causing our CPU to burst with the stream of logs it produces. We already applied:

TAIL=0
BACKLOG=true

But still the issue exists. Are there any other solutions?

Take note:

We are combining logspout with logstash using this image.. bekt/logspout-logstash:master
We are using Docker Swarm Architecture

gbolo commented 6 years ago

@Dean-Christian-Armada what transport are you using? tcp or udp? are you also using tls? I have also noticed high cpu usage when sending a ton of logs. logspout may not be the ideal solution when a dealing with an excessive amount of logs. In this case, it may be best to use the dockerd logging drivers to send to a remote host.