Some data couldn't be associated with k8s metadata when the agent was just started.

[h0cheung]

Component(s)

processor/k8sattributes

What happened?

Description

When the agent is first started, the k8s metadata has not been fully synchronized by the k8sattributes processor. If any data passes through the component at this point, they will not be associated with metadata.

Steps to Reproduce

• start a service that continuously sends a large amount of data to the agent.
• (re)start the agent.

Expected Result

All data should be associated with k8s metadata.

Actual Result

There may be a little data that hasn't be assosicated.

Collector version

v0.95.0

Environment information

Environment

OS: (e.g., "Ubuntu 20.04") Compiler(if manually compiled): (e.g., "go 14.2")

OpenTelemetry Collector configuration

No response

Log output

No response

Additional context

I think it's the best solution to wait for an initial sync when starting k8sattributes processor.

Or we can block data util an initial sync is finished.

[github-actions[bot]]

Pinging code owners:

• processor/k8sattributes: @dmitryax @rmfitzpatrick @fatsheep9146 @TylerHelmuth

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[TylerHelmuth]

I wonder if we could add something to the processor's start function that waits for the kube client connections to be made.

[h0cheung]

I wonder if we could add something to the processor's start function that waits for the kube client connections to be made.

I think it's not enough to only wait for connections. If the connections are just made but metadata hasn't been synced yet, data won't be associated still. We need to wait for an initial complete sync like the implementation in #32622.

[github-actions[bot]]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

• processor/k8sattributes: @dmitryax @rmfitzpatrick @fatsheep9146 @TylerHelmuth

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[github-actions[bot]]

This issue has been closed as inactive because it has been stale for 120 days with no activity.

[orloffv]

Oh noo