search

atomita / fluent-plugin-aws-elasticsearch-service

This repository is extends of https://github.com/uken/fluent-plugin-elasticsearch/ which made connectable to Amazon Elassticsearch Service using Aws Signers V4. Please check the requirements to connect to Amazon Elassticsearch Service without using Aws Signers V4 for before starting use. (reference https://groups.google.com/forum/#!msg/fluentd/uW87VAOqxeE/cfhenicEBAAJ)
MIT License
122 stars 49 forks source link

Workaround to use with elasticsearch gem 7.14 or later #77

Closed Fumipo-Theta closed 2 years ago

Fumipo-Theta commented 2 years ago

Because of the change of the elasticsearch gem (https://github.com/elastic/elasticsearch-ruby/pull/1360), AWS OpenSearch has not been supported. Maybe relates to

I think we need some workaround.

My suggestion is based on this comment. This method will allow any versions and any distributions of elasticsearch. I confirmed that I could transfer messages to AWS OpenSearch Service.

I'm a beginner and I can't think of a better way... If there is a better way, I would love to hear advices.

Fumipo-Theta commented 2 years ago

The new fluent plugin will be made for OpenSearch (mentioned in https://github.com/uken/fluent-plugin-elasticsearch/issues/915#issuecomment-949182607). If it is released, would it be better to fork a new project with using OpenSearch compatible plugin?

cosmo0920 commented 2 years ago

We're planning AWS OpenSearch Service AWS SignV4 request support on fluent-plugin-opensearch plugin itself: https://github.com/fluent/fluent-plugin-opensearch/pull/2

Thanks for the incompatibility notification.