aws / eks-charts

Amazon EKS Helm chart repository
Apache License 2.0
1.19k stars 950 forks source link

aws-for-fluent-bit emits firehose OUTPUT instead of newer kinesis_firehose OUTPUT #1006

Open jbeaken opened 11 months ago

jbeaken commented 11 months ago

Describe the bug firehose enabled creates an OUTPUT of name firehose, which is the old plugin. Logs warn

AWS for Fluent Bit Container Image Version 2.31.11time="2023-10-02T10:33:38Z" level=info msg="A new higher performance Firehose plugin has been released; you are using the old plugin. Check out the new plugin's documentation and consider migrating.\nhttps://docs.fluentbit.io/manual/pipeline/outputs/firehose"

Steps to reproduce

values.yaml :

  enabled: true
  match: "test"
  region: "us-east-1"
  deliveryStream: "my-stream" 

Expected outcome A concise description of what you expected to happen.

    Name            kinesis_firehose
    Match           test
    region          us-east-1
    delivery_stream my-stream

but instead have Name firehose

Environment

Additional Context:

s-maj commented 7 months ago

You can workaround this by using additionalOutputs:

additionalOutputs: |
  [OUTPUT]
      Name            kinesis_firehose
      Match           *
      region          "{{ .cluster.fluentbit.aos_region }}"
      delivery_stream "{{ .cluster.fluentbit.firehose_name }}"
      time_key        time
      time_key_format %Y-%m-%dT%H:%M:%S.%3N