search

open-telemetry / opentelemetry-collector-contrib

Contrib repository for the OpenTelemetry Collector
https://opentelemetry.io
Apache License 2.0
3.03k stars 2.35k forks source link

Add an S3 exporter #2835

Closed rakyll closed 1 year ago

rakyll commented 3 years ago

Various Otel users want to export raw telemetry data for long-term storage and analysis. We should add an S3 exporter that exports the incoming OTLP data points to sharded S3 objects in a bucket. Sharding can be done per telemetry type (metrics, traces, logs) and time (window to be configured by the user). Also we can consider serializing into Ion at the collector optionally.

(You can assign this issue to me.)

github-actions[bot] commented 1 year ago

Pinging code owners for exporter/awss3: @atoulme @pdelewski. See Adding Labels via Comments if you do not have permissions to add labels yourself.

atoulme commented 1 year ago

https://github.com/open-telemetry/opentelemetry-collector-contrib/pull/20912 is open to finish the job, please review.

akshadha22 commented 1 year ago

I'm unable to pull latest release i.e., v0.76.3 from Dockerhub. v0.75.0 doesn't contain aws s3exporter option. When can we expect a new release that includes the latest changes for aws s3 exporter?

MovieStoreGuy commented 1 year ago

Take a look at https://github.com/open-telemetry/opentelemetry-collector-releases/blob/main/distributions/otelcol-contrib/manifest.yaml#LL39C79-L39C92, it should be released as of v0.77.0