elastic / eland

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch
https://eland.readthedocs.io
Apache License 2.0
18 stars 98 forks source link

`AsyncElasticsearch` support? :) #444

Closed igaloly closed 2 years ago

igaloly commented 2 years ago

Hey, I see that there's no support for AsyncElasticsearch Will there be? If so, when?

sethmlarson commented 2 years ago

I'm not sure if there will be just due to the pandas, numpy, and other computing APIs typically being synchronous. What's your use-case for this?

igaloly commented 2 years ago

@sethmlarson Our microservices are async. I want to use this library mainly for fetching complex aggregations from elasticsearch. This is a use case example: https://www.reddit.com/r/mlops/comments/t9ggiq/alternative_for_implementing_machine_learning/

sethmlarson commented 2 years ago

@igaloly Gotcha! Since it's likely this project won't implement async support you should probably go the route of writing these aggregations with Query DSL directly. Most of the aggregations in Eland are 1-to-1 mapped to aggregations in Elasticsearch.

Since it's unlikely we'll implement this I'm going to close for now.