elastic / elastic-agent

Elastic Agent - single, unified way to add monitoring for logs, metrics, and other types of data to a host.
Other
112 stars 126 forks source link

[Flaky Test]: TestFakeInputSuite/TestManager_Chunk – component failed: Failed: pid '<pid>' missed 3 check-ins and will be killed #4203

Open pchila opened 4 months ago

pchila commented 4 months ago

Failing test case

TestFakeInputSuite/TestManager_Chunk

Error message

Error: Received unexpected error: component failed: Failed: pid '7945' missed 3 check-ins and will be killed

Build

https://buildkite.com/elastic/elastic-agent/builds/6855#018d7f0a-a753-4999-9c65-fe283c45e1d7

OS

Mac

Stacktrace and notes

=== FAIL: pkg/component/runtime TestFakeInputSuite/TestManager_Chunk (154.21s)
{"log.level":"info","@timestamp":"2024-02-06T07:58:14.129-0800","log.origin":{"file.name":"runtime/manager.go","file.line":209},"message":"Starting grpc control protocol listener on port 6789 with max_message_size 8388608","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2024-02-06T07:58:45.997-0800","log.logger":"component.runtime.fake-default","log.origin":{"file.name":"runtime/manager.go","file.line":676},"message":"control checkin v2 protocol has chunking enabled","ecs.version":"1.6.0"}
    manager_fake_input_test.go:3524:
            Error Trace:    /Users/admin/builds/bk-agent-prod-orka-1707233426220728417/elastic/elastic-agent/pkg/component/runtime/manager_fake_input_test.go:3524
            Error:          Received unexpected error:
                            component failed: Failed: pid '7945' missed 3 check-ins and will be killed
            Test:           TestFakeInputSuite/TestManager_Chunk
{"log.level":"debug","@timestamp":"2024-02-06T08:00:47.240-0800","log.origin":{"file.name":"runtime/manager.go","file.line":775},"message":"Stopping component \"fake-default\"","ecs.version":"1.6.0"}
{"log.level":"debug","@timestamp":"2024-02-06T08:00:47.277-0800","log.logger":"component.runtime.fake-default","log.origin":{"file.name":"runtime/runtime_comm.go","file.line":255},"message":"check-in stream failed to send expected state: rpc error: code = Unavailable desc = transport is closing","ecs.version":"1.6.0"}
=== FAIL: pkg/component/runtime TestFakeInputSuite (385.98s)
elasticmachine commented 4 months ago

Pinging @elastic/elastic-agent (Team:Elastic-Agent)

rdner commented 3 months ago

Another failure https://buildkite.com/elastic/elastic-agent/builds/7991#018e803c-05b3-44e9-9293-fe0be0cd5443

rdner commented 2 weeks ago

Another failure https://buildkite.com/elastic/elastic-agent/builds/9675#01902579-e5d0-43b3-a4ec-729590885ed0

cmacknz commented 2 weeks ago

CC @blakerouse

blakerouse commented 1 week ago

Seems to be specific to macOS, strange...