elastic / beats

:tropical_fish: Beats - Lightweight shippers for Elasticsearch & Logstash
https://www.elastic.co/products/beats
Other
112 stars 4.93k forks source link

Extended / metricbeat-macosM1-orka && darwin && aarch64 / TestAll/kubernetes.* #33035

Open v1v opened 2 years ago

v1v commented 2 years ago

Flaky Test

image

Stack Trace

[2022-09-09T09:15:17.867Z]     --- FAIL: TestData/docs.plain (0.75s)
[2022-09-09T09:15:17.867Z] 
[2022-09-09T09:15:17.867Z] === FAIL: metricbeat/module/kubernetes/controllermanager TestData (0.75s)
[2022-09-09T09:15:17.867Z] 
[2022-09-09T09:15:17.867Z] === FAIL: metricbeat/module/kubernetes/proxy TestEventMapping (0.01s)
[2022-09-09T09:15:17.868Z]     ptest.go:52: Testing ./_meta/test/metrics.proxy.1.14 file
[2022-09-09T09:15:17.868Z]     ptest.go:116: Event was not expected: {RootFields:{} ModuleFields:null MetricSetFields:{"process":{"cpu":{"sec":121},"fds":{"open":{"count":15}},"memory":{"resident":{"bytes":37040128},"virtual":{"bytes":142323712}},"started":{"sec":1559230373.91}},"sync":{"networkprogramming":{"duration":{"us":{"bucket":{"+Inf":2},"count":2,"sum":6274751245.21}}},"rules":{"duration":{"us":{"bucket":{"+Inf":2654,"1000":1,"1024000":2651,"128000":2651,"16000":1,"16384000":2654,"2000":1,"2048000":2654,"256000":2651,"32000":339,"4000":1,"4096000":2654,"512000":2651,"64000":1931,"8000":1,"8192000":2654},"count":2654,"sum":149421694.93599978}}}}} Index: ID: Namespace: Timestamp:0001-01-01 00:00:00 +0000 UTC Error:<nil> Host: Service: Took:0s Period:0s DisableTimeSeries:false}
[2022-09-09T09:15:17.868Z]     ptest.go:121: Some events were missing:
[2022-09-09T09:15:17.868Z]     ptest.go:123: {{} {} {"process":{"cpu":{"sec":121},"fds":{"open":{"count":15}},"memory":{"resident":{"bytes":37040128},"virtual":{"bytes":142323712}},"started":{"sec":1559230373.91}},"sync":{"networkprogramming":{"duration":{"us":{"bucket":{"+Inf":2,"1000":0,"1024000":0,"128000":0,"131072000":0,"16000":0,"16384000":0,"2000":0,"2048000":0,"256000":0,"262144000":0,"32000":0,"32768000":0,"4000":0,"4096000":0,"512000":0,"524288000":0,"64000":0,"65536000":0,"8000":0,"8192000":0},"count":2,"sum":6274751245.21}}},"rules":{"duration":{"us":{"bucket":{"+Inf":2654,"1000":1,"1024000":2651,"128000":2651,"16000":1,"16384000":2654,"2000":1,"2048000":2654,"256000":2651,"32000":339,"4000":1,"4096000":2654,"512000":2651,"64000":1931,"8000":1,"8192000":2654},"count":2654,"sum":149421694.93599978}}}}}    0001-01-01 00:00:00 +0000 UTC <nil>   0s 0s false}
[2022-09-09T09:15:17.868Z]     ptest.go:125: 
[2022-09-09T09:15:17.868Z] 
[2022-09-09T09:15:17.868Z] === FAIL: metricbeat/module/kubernetes/scheduler TestEventMapping (0.01s)
[2022-09-09T09:15:17.868Z]     ptest.go:52: Testing ./_meta/test/metrics.scheduler.1.14 file
[2022-09-09T09:15:17.868Z]     ptest.go:116: Event was not expected: {RootFields:{} ModuleFields:null MetricSetFields:{"process":{"cpu":{"sec":20},"fds":{"open":{"count":9}},"memory":{"resident":{"bytes":38367232},"virtual":{"bytes":144904192}},"started":{"sec":1560349587.32}},"scheduling":{"e2e":{"duration":{"us":{"bucket":{"+Inf":3,"1024000":3,"128000":3,"16000":2,"16384000":3,"2048000":3,"256000":3,"32000":3,"4096000":3,"512000":3,"64000":3,"8192000":3},"count":3,"sum":42637.21800000001}}},"pod":{"preemption":{"victims":{"count":0}}}}} Index: ID: Namespace: Timestamp:0001-01-01 00:00:00 +0000 UTC Error:<nil> Host: Service: Took:0s Period:0s DisableTimeSeries:false}
[2022-09-09T09:15:17.868Z]     ptest.go:121: Some events were missing:
[2022-09-09T09:15:17.868Z]     ptest.go:123: {{} {} {"process":{"cpu":{"sec":20},"fds":{"open":{"count":9}},"memory":{"resident":{"bytes":38367232},"virtual":{"bytes":144904192}},"started":{"sec":1560349587.32}},"scheduling":{"e2e":{"duration":{"us":{"bucket":{"+Inf":3,"1000":0,"1024000":3,"128000":3,"16000":2,"16384000":3,"2000":0,"2048000":3,"256000":3,"32000":3,"4000":0,"4096000":3,"512000":3,"64000":3,"8000":0,"8192000":3},"count":3,"sum":42637.21800000001}}},"pod":{"preemption":{"victims":{"count":0}}}}}    0001-01-01 00:00:00 +0000 UTC <nil>   0s 0s false}
[2022-09-09T09:15:17.868Z]     ptest.go:125: 
[2022-09-09T09:15:17.868Z] 
[2022-09-09T09:15:17.868Z] DONE 775 tests, 32 skipped, 18 failures in 134.540s
[2022-09-09T09:15:17.868Z] Error: failed to execute go: exit status 1
script returned exit code 1

See logs -> https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/pipelines/beats/branches/PR-32173/runs/5/nodes/3289/steps/3853/log/?start=0

botelastic[bot] commented 2 years ago

This issue doesn't have a Team:<team> label.

v1v commented 2 years ago

To unblock the task to enable the Orka M1 validations in the CI on a weekly basis -> https://github.com/elastic/beats/pull/32173

I just disabled the Orka M1 stage for metricbeat with https://github.com/elastic/beats/pull/32173/commits/c47ccc51eb3fd3811336ecc2ce0c90a0ced8e545

Hence if https://github.com/elastic/beats/pull/32173 gets merged, you can enable back the support for MacOS m1 for metricbeat by uncommenting out the code in metricbeat/Jenkinsfile.yml and attach the github label macos-m1 , if it's not started the stage, please run the build again with /test

dliappis commented 7 months ago

The failure is seen also on Buildkite arm64 workers: https://buildkite.com/elastic/beats-metricbeat/builds/4835#018ed294-371a-4b73-a706-8908a754272c/92-1663

oakrizan commented 5 months ago

Issue still present for metricbeat macOS arm64 tests: https://buildkite.com/elastic/beats-metricbeat/builds/6824#01901705-d136-4461-bcb9-9862c1532624