search

elastic / logstash

Logstash - transport and process your logs, events, or other data
https://www.elastic.co/products/logstash
Other
84 stars 3.5k forks source link

[Pipelines] Add ability to execute Logstash pipelines #16093

Open Erikg346 opened 7 months ago

Erikg346 commented 7 months ago

Describe the feature: Currently, Logstash is able to run on a schedule, but it would be great if there were a way to execute a pipeline through Kibana. Therefore, executing externally and against the predefined schedule. This applies to Logstash inputs like HTTP/HTTPS and SNMP.

Describe the use case: Our team continues to aim to leverage ELK over competitors and it seems like executing a poll ad hoc is not supported. Currently, if we want to achieve this, we will have to edit the Logstash pipelines and then run it. The point of this request is to give more power to the users and give them the ability to execute polling for troubleshooting ad hoc.

kaisecheng commented 3 weeks ago

Logstash has central pipeline management which allow you to add pipelines through kibana anytime :) Image

I close this issue now. Feel free to reopen it if you think CPM does not fit your need.

Erikg346 commented 3 weeks ago

Hey @kaisecheng, Yes I know about this. This request is asking for the ability to execute or run a logstash pipeline without needing to go through here and attempt to reload.

For example, I might have a logstash-snmp configuration to poll every 10 minutes. Then lets say I have a SNMP dashboard where I can click a button and it can externally call the logstash-snmp config to run adhoc.