open-telemetry / opentelemetry-specification

Specifications for OpenTelemetry
https://opentelemetry.io
Apache License 2.0
3.75k stars 889 forks source link

How to trace messages processed with window aggregation? #1862

Open Seanspt opened 3 years ago

Seanspt commented 3 years ago

In spark streaming/flink applications, multiple messages could be aggregated and producing a single message.

The structure suggested in semantic_conventions seems not able to handle the aggregation scenario.

Should mutiple parent be supported for that?

Oberon00 commented 3 years ago

The link you provided does not work.

There is a relevant example in the spec as "batch receiving": https://github.com/open-telemetry/opentelemetry-specification/blob/main/specification/trace/semantic_conventions/messaging.md#batch-receiving I don't think this has been tested in practice though.

Seanspt commented 3 years ago

The link you provided does not work.

There is a relevant example in the spec as "batch receiving": https://github.com/open-telemetry/opentelemetry-specification/blob/main/specification/trace/semantic_conventions/messaging.md#batch-receiving I don't think this has been tested in practice though.

Thanks, the aggregation operation seems more related to Batch processing. As descibed here, links should be used is aggregation/batch processing.