elastic / elasticsearch-hadoop

:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
https://www.elastic.co/products/hadoop
Apache License 2.0
1.93k stars 990 forks source link

Multi-threaded/async http support #602

Open costin opened 8 years ago

costin commented 8 years ago

Currently, each task is using only one thread to send and receive replies from Elastic. In cases where the server has plenty of cores, this might not fully use the available CPU power and increasing the number of tasks might have undesired side effects (and be too big of a hammer).

It would be convenient to provide an option inside the connector directly to increase the number of available threads or better yet, provide async support so that once can write while expecting the result from a previous call.

costin commented 8 years ago

relates to #801