search

elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
69.72k stars 24.67k forks source link

Ingest node: terminate processor #110218

Open andrewkroh opened 3 months ago

andrewkroh commented 3 months ago

Description

Add a new ingest processor to terminate processing. When the processor is invoked, then execution of the ingest pipeline stops (control returns to calling pipeline if there is one).

A pattern we use today in pipelines to abort additional processing is to invoke the fail processor which jumps to the pipeline's on_failure handler, but this has the unwanted side-effect of being associated with a failure state and invokes additional processors (on_failure).

This pipeline is an example of where this would be used. I would rather abort the processing at this point without adding a failure message.

elasticsearchmachine commented 3 months ago

Pinging @elastic/es-data-management (Team:Data Management)