elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
69.98k stars 24.75k forks source link

Executing enrich policies requires an ingest node #115107

Open ckauf opened 1 week ago

ckauf commented 1 week ago

Executing Enrich Policies require ingest nodes. This used to be a sensible requirement because the only place to use this policy would have been in an ingest pipeline via enrich processor. However, with the introduction of ES|QL and the ENRICH function, an ingest pipeline is not required anymore. Therefore the requirement to have a node with an ingest role doesn't apply anymore.

This especially is true for CCS scenarios, where the enrichment of the data would happen on the local/coordinating cluster where users would usually not require Ingest Nodes at all.

Please validate if the check can be removed and the execution can fall back to data_content/data_hot nodes.

elasticsearchmachine commented 1 week ago

Pinging @elastic/es-data-management (Team:Data Management)