When starting up module-manager with the image 09f69f98, it will fail by timing out. The root cause is unclear but after some initial analysis with @adityabhatia we think it is not related to in code startup but it times out during the manager start.
28
1.6632258213947754e+09 INFO controller-runtime.metrics Metrics server is starting to listen {"addr": ":2020"}
27
1.6632258213957431e+09 INFO workers Starting module-manager worker with id 3
26
1.6632258213957667e+09 INFO workers Starting module-manager worker with id 1
25
1.6632258213957615e+09 INFO workers Starting module-manager worker with id 2
24
1.663225821395819e+09 INFO setup starting manager
23
1.6632258213958545e+09 INFO workers Starting module-manager worker with id 4
22
1.6632258213959134e+09 INFO Starting server {"kind": "health probe", "addr": "[::]:2021"}
21
1.66322582139593e+09 INFO Starting server {"path": "/metrics", "kind": "metrics", "addr": "[::]:2020"}
20
I0915 07:10:21.395940 1 leaderelection.go:248] attempting to acquire leader lease kcp-system/7f5e28d0.kyma-project.io...
19
I0915 07:10:37.086682 1 leaderelection.go:258] successfully acquired lease kcp-system/7f5e28d0.kyma-project.io
18
1.6632258370868614e+09 INFO Listener is starting up... {"Module": "Listener", "Addr": ":2022", "ApiPath": "/v1/manifest/event"}
17
1.6632258370867565e+09 DEBUG events Normal {"object": {"kind":"Lease","namespace":"kcp-system","name":"7f5e28d0.kyma-project.io","uid":"9926a83a-11f3-4bde-b7a0-4bf6a4307915","apiVersion":"coordination.k8s.io/v1","resourceVersion":"769922022"}, "reason": "LeaderElection", "message": "kmm-manager-7fcbc99b85-mkx8b_ed31f2e8-af2a-4cad-80e3-1581d8935e96 became leader"}
16
1.66322583708704e+09 INFO Starting EventSource {"controller": "manifest", "controllerGroup": "operator.kyma-project.io", "controllerKind": "Manifest", "source": "kind source: *v1alpha1.Manifest"}
15
1.6632258370870733e+09 INFO Starting EventSource {"controller": "manifest", "controllerGroup": "operator.kyma-project.io", "controllerKind": "Manifest", "source": "kind source: *v1.Secret"}
14
1.663225837087082e+09 INFO Starting EventSource {"controller": "manifest", "controllerGroup": "operator.kyma-project.io", "controllerKind": "Manifest", "source": "channel source: 0xc0001140a0"}
13
1.6632258370871062e+09 INFO Starting Controller {"controller": "manifest", "controllerGroup": "operator.kyma-project.io", "controllerKind": "Manifest"}
12
1.663225837188563e+09 INFO Starting workers {"controller": "manifest", "controllerGroup": "operator.kyma-project.io", "controllerKind": "Manifest", "worker count": 1}
11
1.6632258812020292e+09 INFO Stopping and waiting for non leader election runnables
10
1.6632258812020717e+09 INFO Stopping and waiting for leader election runnables
9
1.6632258812020843e+09 INFO Shutdown signal received, waiting for all workers to finish {"controller": "manifest", "controllerGroup": "operator.kyma-project.io", "controllerKind": "Manifest"}
8
1.6632258812020903e+09 INFO SKR events listener is shutting down: context got closed {"Module": "Listener"}
7
1.663225881202124e+09 INFO All workers finished {"controller": "manifest", "controllerGroup": "operator.kyma-project.io", "controllerKind": "Manifest"}
6
1.6632258812021577e+09 INFO Stopping and waiting for caches
5
1.6632258812021341e+09 ERROR error received after stop sequence was engaged {"error": "context canceled"}
4
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
3
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/manager/internal.go:541
2
1.6632258812022293e+09 INFO Stopping and waiting for webhooks
1
1.6632258812022498e+09 INFO Wait completed, proceeding to shutdown the manager
adityabhatia
commented
2 years ago
When starting up module-manager with the image
09f69f98, it will fail by timing out. The root cause is unclear but after some initial analysis with @adityabhatia we think it is not related to in code startup but it times out during the manager start.