search

f5 / otel-arrow-adapter

Adapter used to convert OTEL batches to/from OTEL Arrow batches in both directions.
Apache License 2.0
39 stars 6 forks source link

Add filereceiver component with updated functionality #186

Closed moh-osman3 closed 1 year ago

moh-osman3 commented 1 year ago

What does this PR do? This PR is part 2 of https://github.com/f5/otel-arrow-adapter/pull/185 Adds the filereceivercomponent directly rather than using the component currently in opentelemetry-collector-contrib package.

Adding the component directly allows us to use the functionality from this https://github.com/open-telemetry/opentelemetry-collector-contrib/pull/22080 open in the contrib repository. This contrib PR is taking a while to get approved so in the meantime it might be better to add these changes to start using these components to replay data in production.

Example config:

receivers:
  file:
    path: ../../gen/receiver/filereceiver/testdata/metrics.json
    compression: zstd
    format: json

Testing Ran the cmd/otelarrowcol with the filereceiver component and successfully read from file in the desired format/compression

(cc: @jmacd)

lquerel commented 1 year ago

@moh-osman3 there are some conflicts to resolve that prevent to merge this PR.

moh-osman3 commented 1 year ago

@lquerel rebased and fixed the conflict. Thank you!

lquerel commented 1 year ago

LGTM