kubernetes-sigs / cluster-api

Home for Cluster API, a subproject of sig-cluster-lifecycle
https://cluster-api.sigs.k8s.io
Apache License 2.0
3.59k stars 1.32k forks source link

[e2e test flake] Timed waiting for all control plane replicas to be updated #11454

Open cahillsf opened 5 days ago

cahillsf commented 5 days ago

Which jobs are flaking?

periodic-cluster-api-e2e-mink8s-main periodic-cluster-api-e2e-main

Which tests are flaking?

When testing KCP adoption Should adopt up-to-date control plane Machines without modification

Since when has it been flaking?

2024-11-05 is the first instance of this flake i can find: https://storage.googleapis.com/k8s-triage/index.html?date=2024-11-06&text=Timed%20waiting%20for%20all%20control%20plane%20replicas%20to%20be%20updated&job=.*periodic-cluster-api-e2e.*

now it appears quite consistently: https://storage.googleapis.com/k8s-triage/index.html?date=2024-11-20&text=Timed%20waiting%20for%20all%20control%20plane%20replicas%20to%20be%20updated&job=.*periodic-cluster-api-e2e.*

Testgrid link

https://testgrid.k8s.io/sig-cluster-lifecycle-cluster-api#capi-e2e-main

Reason for failure (if possible)

TBD (have not had time to investigate thoroghly)

Anything else we need to know?

example failed job: https://prow.k8s.io/view/gs/kubernetes-ci-logs/logs/periodic-cluster-api-e2e-mink8s-main/1858697443558821888

have filtered commits on main to around the time this flake popped up: https://github.com/kubernetes-sigs/cluster-api/commits/main/?since=2024-11-03&until=2024-11-05

have not have time to further investigate yet

Label(s) to be applied

/kind flake

k8s-ci-robot commented 5 days ago

This issue is currently awaiting triage.

If CAPI contributors determine this is a relevant issue, they will accept it by applying the triage/accepted label and provide further guidance.

The triage/accepted label can be added by org members by writing /triage accepted in a comment.

Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes-sigs/prow](https://github.com/kubernetes-sigs/prow/issues/new?title=Prow%20issue:) repository.
cahillsf commented 5 days ago

/area e2e-testing

sivchari commented 5 days ago

I confirm this flake. /assign