opensearch-project / user-behavior-insights

User Behavior Insights plugin for OpenSearch
Apache License 2.0
20 stars 5 forks source link

[FEATURE] Support using the new bulk API in Data Prepper for indexing queries #33

Open jzonthemtn opened 1 month ago

jzonthemtn commented 1 month ago

Data Prepper has recently added support for the bulk API. Using this endpoint in Data Prepper would be more efficient than indexing each query individually. This may require batching queries for sending to Data Prepper instead of the current paradigm of sending each query indivdually.

See https://github.com/opensearch-project/data-prepper/issues/248.