search

logstash-plugins / logstash-output-file

Apache License 2.0
23 stars 53 forks source link

The pipeline and workers stop permanently when there is no more space on the output path #91

Open leludo84 opened 3 years ago

leludo84 commented 3 years ago

The pipeline and workers stops permanently when there is no more space on the output path with the following exception:

logstash_1 | [2020-11-25T12:31:36,771][ERROR][logstash.javapipeline ][input] Pipeline worker error, the pipeline will be stopped {:pipeline_id=>"input", :error=>"(ENOSPC) No space left on device ....

The expected behaviour should be to block pipeline until the space is freed (no error or exception, only warning message). It's the behaviour of mains outputs plugins on error.

Furthermore, is it possible to design the same concept of "high watermark" present in elasticsearch ? ( ES stop writting from 95% disk usage)

ES version: official docker image logstash:7.9.2

SidathWeerasinghe commented 2 years ago

@leludo84, Did you resolve this issue? Can you please let us know how you resolve this issue?