search

mallocator / Elasticsearch-Exporter

A small script to export data from one Elasticsearch cluster into another.
Apache License 2.0
593 stars 112 forks source link

Throttling in ES when the cluster nodes have High CPU #100

Closed vtrifonov closed 9 years ago

vtrifonov commented 9 years ago

Thanks for accepting my previous pull request, this is great!

Today I've spent some time to add some type of throttling for the elastic search requests when the CPU of any of the cluster nodes have reached a certain limit, so would you please take a look at my suggestion and accept the pull request if you like this feature. The idea is to be able to run the tool on a production cluster and not affect the performance by overloading the cluster itself. Thanks again for Your time and for the great tool!

mallocator commented 9 years ago

Thanks for the patch. I'm considering if this is the best way to do it, but the feature will make it in one way or another. Also thanks for finding the bugs with the targetStats. Unfortunately I have very little time at the moment and so my reaction time is slow (as is development), but I'm glad that v2.0 actually works for some people.

mallocator commented 9 years ago

The latest commit should include similar functionality.