search

Unstructured-IO / unstructured

Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
https://www.unstructured.io/
Apache License 2.0
7.49k stars 584 forks source link

Add ability to pass pipeline param to Elasticsearch connector #3166

Open aag6z opened 4 weeks ago

aag6z commented 4 weeks ago

Is your feature request related to a problem? Please describe. Elasticsearch has the ability to transform data as its ingested via ingest pipelines. They need to be passed in as a param to the bulk API. https://www.elastic.co/guide/en/elasticsearch/reference/current/ingest.html

Describe the solution you'd like Build a pipeline param into the connector to pass in an ingest pipeline

MthwRobinson commented 3 weeks ago

Thanks @aag6z - we'll take a closer look at the docs you linked and follow up from there.