[Flaky test] Test_ComponentStatusReporting_SharedInstance flaky

songy23 commented 3 weeks ago

https://github.com/open-telemetry/opentelemetry-collector/actions/runs/10473477699/job/29005426543?pr=10915

--- FAIL: Test_ComponentStatusReporting_SharedInstance (15.01s)
    status_test.go:117: 
            Error Trace:    D:/a/opentelemetry-collector/opentelemetry-collector/internal/e2e/status_test.go:117
            Error:          Not equal: 
                            expected: 2
                            actual  : 6
            Test:           Test_ComponentStatusReporting_SharedInstance
    status_test.go:120: 
            Error Trace:    D:/a/opentelemetry-collector/opentelemetry-collector/internal/e2e/status_test.go:120
            Error:          Not equal: 
                            expected: 6
                            actual  : 7
            Test:           Test_ComponentStatusReporting_SharedInstance
FAIL
FAIL    go.opentelemetry.io/collector/internal/e2e  18.766s
FAIL

songy23 commented 3 weeks ago

This happens on Ubuntu as well https://github.com/open-telemetry/opentelemetry-collector/actions/runs/10473495585/job/29005525483?pr=10918

songy23 commented 2 weeks ago

Unfortunately this is still happening, e.g. 3hr ago on mainline https://github.com/open-telemetry/opentelemetry-collector/actions/runs/10599797655/job/29375720642#step:6:527

--- FAIL: Test_ComponentStatusReporting_SharedInstance (15.02s)
    status_test.go:130: checking errors for metrics, - Receiver - test
    status_test.go:154: events received: StatusStarting,StatusRecoverableError,StatusOK,StatusStopping,StatusStopped,
    status_test.go:130: checking errors for traces, - Receiver - test
    status_test.go:142: 
            Error Trace:    /home/runner/work/opentelemetry-collector/opentelemetry-collector/internal/e2e/status_test.go:142
            Error:          Not equal: 
                            expected: 2
                            actual  : 6
            Test:           Test_ComponentStatusReporting_SharedInstance
    status_test.go:145: 
            Error Trace:    /home/runner/work/opentelemetry-collector/opentelemetry-collector/internal/e2e/status_test.go:145
            Error:          Not equal: 
                            expected: 6
                            actual  : 7
            Test:           Test_ComponentStatusReporting_SharedInstance
    status_test.go:154: events received: StatusStarting,StatusRecoverableError,StatusStopping,StatusStopped,
FAIL
FAIL    go.opentelemetry.io/collector/internal/e2e  16.885s

crobert-1 commented 1 week ago

+1 freq: https://github.com/open-telemetry/opentelemetry-collector/actions/runs/10741250077/job/29791200652?pr=11073

--- FAIL: Test_ComponentStatusReporting_SharedInstance (15.01s)
    status_test.go:130: checking errors for traces, - Receiver - test
    status_test.go:154: events received: StatusStarting,StatusRecoverableError,StatusOK,StatusStopping,StatusStopped,
    status_test.go:130: checking errors for metrics, - Receiver - test
    status_test.go:142: 
            Error Trace:    /home/runner/work/opentelemetry-collector/opentelemetry-collector/internal/e2e/status_test.go:142
            Error:          Not equal: 
                            expected: 2
                            actual  : 6
            Test:           Test_ComponentStatusReporting_SharedInstance
    status_test.go:145: 
            Error Trace:    /home/runner/work/opentelemetry-collector/opentelemetry-collector/internal/e2e/status_test.go:145
            Error:          Not equal: 
                            expected: 6
                            actual  : 7
            Test:           Test_ComponentStatusReporting_SharedInstance
    status_test.go:154: events received: StatusStarting,StatusRecoverableError,StatusStopping,StatusStopped,
FAIL

songy23 commented 4 days ago

Looks like this is still happening 🤦 https://github.com/open-telemetry/opentelemetry-collector/actions/runs/10806189674/job/29974542821?pr=11128

--- FAIL: Test_ComponentStatusReporting_SharedInstance (0.00s)
    status_test.go:133: checking errors for traces, - Receiver - test
    status_test.go:157: events received: StatusStarting,StatusRecoverableError,StatusOK,StatusStopping,StatusStopped,
    status_test.go:133: checking errors for metrics, - Receiver - test
    status_test.go:145: 
            Error Trace:    D:/a/opentelemetry-collector/opentelemetry-collector/internal/e2e/status_test.go:145
            Error:          Not equal: 
                            expected: 2
                            actual  : 6
            Test:           Test_ComponentStatusReporting_SharedInstance
    status_test.go:148: 
            Error Trace:    D:/a/opentelemetry-collector/opentelemetry-collector/internal/e2e/status_test.go:148
            Error:          Not equal: 
                            expected: 6
                            actual  : 7
            Test:           Test_ComponentStatusReporting_SharedInstance
    status_test.go:157: events received: StatusStarting,StatusRecoverableError,StatusStopping,StatusStopped,
FAIL
FAIL    go.opentelemetry.io/collector/internal/e2e  3.161s
FAIL

open-telemetry / opentelemetry-collector

[Flaky test] Test_ComponentStatusReporting_SharedInstance flaky #10927