elastic / logstash

Logstash - transport and process your logs, events, or other data
https://www.elastic.co/products/logstash
Other
14.11k stars 3.48k forks source link

Add timeout option to filters #5649

Open talevy opened 8 years ago

talevy commented 8 years ago

I suggest a new optional timeout option be added to all filter plugins. Although not all filters would cleanly support being interrupted due to possible partial data updates, many filters would benefit from such an option without much change. Some filters go out to the network to do I/O and may take too long, etc.

both https://github.com/logstash-plugins/logstash-filter-grok/issues/82 and https://github.com/logstash-plugins/logstash-filter-grok/issues/65 discuss the need for a timeout option for the grok filter. I believe this feature is applicable to all plugins, not just Grok. All plugins may take too long for your liking.

yinrong commented 5 years ago

+1 filter hangs and extremely hard to find which one hangs