Elasticsearch consumer failing is with incompatibility error

aws-solutions / content-analysis-on-aws

As of August 30, 2023, this AWS Solution is no longer available. Existing deployments will continue to run. The functionality provided by Content Analysis on AWS will be superseded with functionality in Media2Cloud on AWS and Content Localization on AWS. We encourage you to explore these solutions.

https://aws.amazon.com/solutions/implementations/aws-content-analysis/

Apache License 2.0

96 stars 47 forks source link

Elasticsearch consumer failing is with incompatibility error #31

Closed ianwow closed 3 years ago

ianwow commented 3 years ago

I just started noticing that the data pipeline is no longer sending data to Elasticsearch. Digging into the logs, the bulk load function is failing with this error:

Unable to load data into es: The client noticed that the server is not a supported distribution of Elasticsearch

I'm seeing this happening with AWS Elasticsearch Service version 7.10

ianwow commented 3 years ago

To fix this, we need to peg the python elasticsearch library to version 7.13.4 because the latest version (7.14.0) artificially breaks compatibility