search

elastic / logstash

Logstash - transport and process your logs, events, or other data
https://www.elastic.co/products/logstash
Other
52 stars 3.5k forks source link

Pipeline management API #9451

Open elasticmachine opened 6 years ago

elasticmachine commented 6 years ago

Original comment by @acchen97:

Offering a direct API for the pipeline mgmt feature would allow customers to plug existing config mgmt or CIDC tools with the pipeline mgmt UI. A REST API here can simply just consist of the basic CRUD operations.

As an example, one may be using git for version control, and may want to pull new versions via Jenkins, Ansible, etc. It would be great if it could push the new versions directly into our pipeline mgmt UI to take advantage of the dynamic Logstash pipeline polling feature.

/cc @ycombinator @andrewvc

elasticmachine commented 6 years ago

Original comment by @skearns64:

@acchen97 - Today, the UI is just writing a specific document structure into a specific index - is this about documenting that index and document structure and showing how to use ES APIs to create the pipeline documents, or is there more to the API here?

waynetaylor commented 5 years ago

@elasticmachine documenting would be a start but I also agree this as an enhancement.

ycombinator commented 5 years ago

The Logstash Configuration Management API is documented here: https://www.elastic.co/guide/en/kibana/master/logstash-configuration-management-api.html

acchen97 commented 5 years ago

@karenzone these management APIs are in Kibana and therefore in the Kibana docs, which can be tricky for LS users to find from a discovery standpoint. Could we find a way to link to those docs from the LS centralized management docs? This is key for users wanting to integrate their LS pipelines through the API via 3rd party CICD or change control systems.