opensearch-project / logstash-output-opensearch

A Logstash plugin that sends event data to a OpenSearch clusters and stores as an index.
https://opensearch.org/docs/latest/clients/logstash/index/
Apache License 2.0
104 stars 80 forks source link

Options to discard retries caused by 429 errors #211

Open r0b3rt24 opened 1 year ago

r0b3rt24 commented 1 year ago

Is your feature request related to a problem? Please describe. When logstash encounters 429 errors when delivering messages, It will retry infinitely. That ends up in message stuck in memory queue infinitely. If such cases accumulates, it will eventually stall the ingestion.

Describe the solution you'd like An option to discard all delivery failed after a certain number of retries.

Describe alternatives you've considered N/A

N/A