Closed sylvainOL closed 2 months ago
hey, thanks for reporting! Do you have an idea what could help fixing the issue? Have you tried playing around with gem version upgrades perhaps? I would specifically prefer to look at the v1.15-staging image as we are going to release a new operator version with that fluentd image as the default.
Hi @pepov, no I didn't for now (to be honest, we plan to move out from elasticsearch to loki in a few weeks...) I'll try to see if I can do something but looking at elastic-ruby, it seems complex to have a solution satisfying both elasticsearch < 7 and >= 8 :(
I've just figured out that you set elasticsearch-ruby
to 8.7.1
in v1.15-staging
.
So it won't work with elasticsearch < 8.0.0
because of https://github.com/elastic/elasticsearch-ruby/blob/v8.7.1/elasticsearch/lib/elasticsearch.rb#L112-L115
I'm thinking of creating a separate image that works with legacy elasticsearch versions, can you help me with the correct gem version to help with that?
hey @pepov just encountered same issue.. this is gem version thats used in
ghcr.io/banzaicloud/fluentd:v1.14.6-alpine-5 which we use with Elasticsearch 7.10
elasticsearch (7.13.3) elasticsearch-api (7.13.3) elasticsearch-transport (7.13.3) elasticsearch-xpack (7.13.3)
to add even using yours 1.14 image which according to this https://github.com/kube-logging/fluentd-images/blob/5a36a885bed87b3ab803b2cf8cd626684abda18f/v1.14/Dockerfile#L40 should work still fails..as one user mentioned also above
If anyone would still need this we have a filters
image which does not contain output plugins and you can add your own specific version of elasticsearch dependencies to use.
Similar to this one, but with your desired elasticsearch version: https://github.com/kube-logging/logging-operator/issues/1706#issuecomment-2020445093
Hello, I'm trying to use
ghcr.io/kube-logging/fluentd:v1.15-build.84
orghcr.io/kube-logging/fluentd:v1.14-build.84
with an elasticsearch cluster v7 as output. I've also testedghcr.io/kube-logging/fluentd:v1.15-staging-build.86
and the issue is still hereI'm getting this error:
I've tried adding :
but it doesn't change anything.
DIgging into the container, I see that
elasticsearch
gem is present two times (one in version7.13.3
as aked in Dockerfile, one in version8.7.1
) and we hit this lines: https://github.com/elastic/elasticsearch-ruby/blob/v8.7.1/elasticsearch/lib/elasticsearch.rb#L112-L115using the "old"
ghcr.io/banzaicloud/fluentd:v1.14.6-alpine-666
, it works without any issues