search

imksoo / tootsearch

This is a search service of Mastodon's toot contents.
https://tootsearch.chotto.moe/
GNU Affero General Public License v3.0
8 stars 1 forks source link

Use Curator 5 for data/index lifecycling #1

Open geekpete opened 7 years ago

geekpete commented 7 years ago

Have you seen Curator 5 which can be used for life-cycling old indices/data? https://www.elastic.co/guide/en/elasticsearch/client/curator/current/index.html

It's the official Elastic tool for index retention management that could replace your existing custom script and allow more flexibility,etc: https://github.com/imksoo/tootsearch/blob/master/remove_old_index.sh

imksoo commented 7 years ago

Thank you for your information.

But, my Elasticsearch Service instance (version 5.1) does not support Curator. I would like to use Curator ater updating the instance.

Ref.: https://aws.amazon.com/jp/about-aws/whats-new/2017/06/elasticsearch-5-3-now-available-on-amazon-elasticsearch-service/ https://github.com/elastic/curator/issues/880

geekpete commented 7 years ago

That and many other great reasons to upgrade :)

If you need any help upgrading, let me know and I'd be glad to lend a hand if you want.

imksoo commented 7 years ago

Curator is very powerful !! https://github.com/imksoo/tootsearch/blob/master/remove_old_index.sh.curator

geekpete commented 7 years ago

It makes lots of programmatic tasks much easier than writing a script yourself, it should make life easier for regular maintenance tasks.

Lots added in version 5 of curator too: https://www.elastic.co/guide/en/elasticsearch/client/curator/current/about-features.html like rollover API support and reindex API support.