criteo / mesos-external-container-logger

Mesos container logger module for logging to processes, backported from MESOS-6003
Other
13 stars 11 forks source link

Filebeat sessions are not cleared automatically when the stream stops. Even after using -once flag while starting filebeat process #5

Closed AbacusIntegrationPlatform closed 6 years ago

AbacusIntegrationPlatform commented 6 years ago

Filebeat sessions are not cleared automatically when the stream stops. Even after using -once flag while starting filebeat process.

I have tried to put -once flag along with shutdown_timeout as 0. In this case the logs are not even forwarding to Graylog. Is there a way to clear the filebeat sessions after the container terminates automatically ?

wjoel commented 6 years ago

You'd have to solve that in your logging script and/or Filebeat configuration. It's not the responsibility of this logging module. The Filebeat community might be able to help you out. I don't use Filebeat (or Mesos) nowadays.

AbacusIntegrationPlatform commented 6 years ago

Thanks WJoel. I will raise an issue with Filebeat for this.

wjoel commented 6 years ago

Please add information if you got a solution to this from the Filebeat people. Thanks!