search

elastic / curator

Curator: Tending your Elasticsearch indices
Other
3.04k stars 637 forks source link

Feature request: allow filtering nodes by attribute when shrinking #1087

Open dandrestor opened 6 years ago

dandrestor commented 6 years ago

The title pretty much says it all. It would be nice to be able to do something like:

action: shrink
  node_filters:
    exclude_attribute:
      attribute: box_type
      value: hot

Could also be useful to have an include_attribute as well. May also apply to other actions also. Perhaps it's a good idea to decouple the node filters from the shrink action?

outworlder commented 5 years ago

👍 for this feature.

I haven't figured out a way to use curator to reliably shrink indices when you have a hot/warm architecture(without a dedicated shrink node). It is very common that a hot node will have more space than warm nodes, after the shards have migrated away. This is ok, except if curator selects an index which is sitting in a warm node. When that happens, it tries to move the index to a given hot node. Elasticsearch will now have a conflicting allocation, we asked for a specific node, which is not a 'warm' node.

rshivane commented 5 years ago

Plus 💯 for this request. @outworlder comment describes our situation too