f5 / otel-arrow-adapter

Adapter used to convert OTEL batches to/from OTEL Arrow batches in both directions.
Apache License 2.0
39 stars 6 forks source link

Adding obfuscation processor component #187

Closed moh-osman3 closed 1 year ago

moh-osman3 commented 1 year ago

This PR:

Simple Test

$ cd collector/cmd/otelarrowcol
$ go run . --config ./config/simple-record.yaml

This writes zstd compressed and obfuscated traces to an output file (e.g cmd/otelarrowcol/recorded_traces.json)

This can be replayed by running

$ cd collector/cmd/otelarrowcol
$ go run . --config ./config/simple-replay.yaml

This reads the data in the recorded file and rewrites it in an uncompressed form

You can also read in the compressed file recorded_traces.json with the the benchmark tools e.g.

$ go run ./tools/trace_benchmark --format json collector/cmd/otelarrowcol/recorded_traces.json

(cc @jmacd @lquerel)

jmacd commented 1 year ago

I will check this branch out and try it. I'd like the example configs to move into the examples/ directory, for one thing -- @moh-osman3 is out of town this week and I will carry this forward.

jmacd commented 1 year ago

Replaced by #191