Closed stockmaj closed 5 months ago
Hello! Thank you for filing an issue.
The maintainers will triage your issue shortly.
In the meantime, please take a look at the troubleshooting guide for bug reports.
If this is a feature request, please review our contribution guidelines.
Hey @stockmaj,
Please provide the controller log, so I can try to understand what is happening during deletion
I just created a new arc-controller and new scale set, then deleted the scale set. I used a different scale set namespace than above, but everything else was identical.
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Update strategy set to:","updateStrategy":"immediate"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"AutoscalingListener logging parameters changed","LogLevel":"info","LogFormat":"json"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Registering scale set metrics"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"starting manager"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","logger":"controller-runtime.metrics","message":"Starting metrics server"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","logger":"controller-runtime.metrics","message":"Serving metrics server","bindAddress":":8080","secure":false}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","source":"kind source: *v1alpha1.AutoscalingRunnerSet"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","source":"kind source: *v1alpha1.EphemeralRunnerSet"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","source":"kind source: *v1alpha1.AutoscalingListener"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"ephemeralrunnerset","controllerGroup":"actions.github.com","controllerKind":"EphemeralRunnerSet","source":"kind source: *v1alpha1.EphemeralRunnerSet"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"autoscalinglistener","controllerGroup":"actions.github.com","controllerKind":"AutoscalingListener","source":"kind source: *v1alpha1.AutoscalingListener"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"autoscalinglistener","controllerGroup":"actions.github.com","controllerKind":"AutoscalingListener","source":"kind source: *v1.Pod"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"autoscalinglistener","controllerGroup":"actions.github.com","controllerKind":"AutoscalingListener","source":"kind source: *v1.ServiceAccount"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"autoscalinglistener","controllerGroup":"actions.github.com","controllerKind":"AutoscalingListener","source":"kind source: *v1.Role"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting Controller","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"autoscalinglistener","controllerGroup":"actions.github.com","controllerKind":"AutoscalingListener","source":"kind source: *v1.RoleBinding"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting Controller","controller":"autoscalinglistener","controllerGroup":"actions.github.com","controllerKind":"AutoscalingListener"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"ephemeralrunnerset","controllerGroup":"actions.github.com","controllerKind":"EphemeralRunnerSet","source":"kind source: *v1alpha1.EphemeralRunner"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting Controller","controller":"ephemeralrunnerset","controllerGroup":"actions.github.com","controllerKind":"EphemeralRunnerSet"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"ephemeral-runner-controller","controllerGroup":"actions.github.com","controllerKind":"EphemeralRunner","source":"kind source: *v1alpha1.EphemeralRunner"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting EventSource","controller":"ephemeral-runner-controller","controllerGroup":"actions.github.com","controllerKind":"EphemeralRunner","source":"kind source: *v1.Pod"}
{"severity":"info","ts":"2024-06-05T16:37:38Z","message":"Starting Controller","controller":"ephemeral-runner-controller","controllerGroup":"actions.github.com","controllerKind":"EphemeralRunner"}
{"severity":"info","ts":"2024-06-05T16:37:39Z","message":"Starting workers","controller":"autoscalinglistener","controllerGroup":"actions.github.com","controllerKind":"AutoscalingListener","worker count":1}
{"severity":"info","ts":"2024-06-05T16:37:39Z","message":"Starting workers","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","worker count":1}
{"severity":"info","ts":"2024-06-05T16:37:39Z","message":"Starting workers","controller":"ephemeral-runner-controller","controllerGroup":"actions.github.com","controllerKind":"EphemeralRunner","worker count":1}
{"severity":"info","ts":"2024-06-05T16:37:39Z","message":"Starting workers","controller":"ephemeralrunnerset","controllerGroup":"actions.github.com","controllerKind":"EphemeralRunnerSet","worker count":1}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Adding finalizer","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Successfully added finalizer","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:37Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"57e654f0-8863-4e73-bc2c-b5b3d77d4f49","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:37Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"51a7e5a2-06b9-4d72-ba25-2e1cab6fb9bb","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:37Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"ae389903-9aa9-4945-a991-0bcfa77656eb","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:37Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"a898f2c5-3078-44fa-ad4e-d278dd16fe16","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:37Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"95777b32-117e-4628-888e-61845226ac12","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:37Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"05b4b974-3def-4831-ae8a-c998b84b0c49","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:37Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"7458e65b-49e5-4045-9057-54f993d162ce","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:37Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:37Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"0168c77a-f8f2-4e67-9c49-afe46b122300","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:38Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:38Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:38Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:38Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"112faa25-6d41-4c9e-8fe2-788072e0835b","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:39Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:39Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:39Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:39Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"d28120f4-fab1-44b2-8456-7ccef8fa6582","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:42Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:42Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:42Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:42Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"8d42be22-c801-4c44-8918-5ed0b6c4b8a3","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:47Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:47Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:47Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:47Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"bebc06a9-8f00-4ac8-801d-339363458592","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:40:57Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:40:57Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:40:57Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:40:57Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"d5e98885-5dec-4be0-bcf8-8db7fcfd4b9b","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:41:18Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:41:18Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:41:18Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:41:18Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"af17c698-e03f-4835-a2f5-a0dc1a85f292","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:41:59Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:41:59Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:41:59Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:41:59Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"0d25ea3f-d555-4e67-9bab-e789b6d45f21","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:43:21Z","logger":"AutoscalingRunnerSet","message":"Runner scale set id annotation does not exist. Creating a new runner scale set.","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:43:21Z","logger":"AutoscalingRunnerSet","message":"Creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"error","ts":"2024-06-05T16:43:21Z","logger":"AutoscalingRunnerSet","message":"Failed to initialize Actions service client for creating a new runner scale set","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).createRunnerScaleSet\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:423\ngithub.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingRunnerSetReconciler).Reconcile\n\tgithub.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalingrunnerset_controller.go:195\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"error","ts":"2024-06-05T16:43:21Z","message":"Reconciler error","controller":"autoscalingrunnerset","controllerGroup":"actions.github.com","controllerKind":"AutoscalingRunnerSet","AutoscalingRunnerSet":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"namespace":"arc-scale-set-ubuntu-basic","name":"ubuntu-basic","reconcileID":"d86a2905-5996-4ad0-a401-c38c19a8f180","error":"failed to find GitHub config secret: secrets \"arc-scale-set-ubuntu-basic-secrets\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.16.3/pkg/internal/controller/controller.go:227"}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"Deleting resources","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"Cleaning up the listener","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"Listener is deleted","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"Cleaning up ephemeral runner sets","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"All ephemeral runner sets are deleted","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"Skipping cleaning up kubernetes mode service account","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"reason":"annotation key \"actions.github.com/cleanup-kubernetes-mode-role-binding-name\" not present"}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"Skipping cleaning up kubernetes mode role","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"reason":"annotation key \"actions.github.com/cleanup-kubernetes-mode-role-name\" not present"}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"Skipping cleaning up kubernetes mode role binding","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"reason":"annotation key \"actions.github.com/cleanup-kubernetes-mode-service-account-name\" not present"}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"Removing finalizer from no permission service account","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"name":"ubuntu-basic-gha-rs-no-permission"}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"Removed finalizer from no permission service account","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"name":"ubuntu-basic-gha-rs-no-permission"}
{"severity":"info","ts":"2024-06-05T16:45:56Z","logger":"AutoscalingRunnerSet","message":"Waiting for dependent resources to be deleted","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Deleting resources","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Cleaning up the listener","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Listener is deleted","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Cleaning up ephemeral runner sets","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"All ephemeral runner sets are deleted","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Skipping cleaning up kubernetes mode service account","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"reason":"annotation key \"actions.github.com/cleanup-kubernetes-mode-role-binding-name\" not present"}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Skipping cleaning up kubernetes mode role","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"reason":"annotation key \"actions.github.com/cleanup-kubernetes-mode-role-name\" not present"}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Skipping cleaning up kubernetes mode role binding","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"reason":"annotation key \"actions.github.com/cleanup-kubernetes-mode-service-account-name\" not present"}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Removing finalizer from no permission service account","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"name":"ubuntu-basic-gha-rs-no-permission"}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"No permission service account has already been deleted","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"name":"ubuntu-basic-gha-rs-no-permission"}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Skipping cleaning up no permission service account","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"reason":"annotation key \"actions.github.com/cleanup-github-secret-name\" not present"}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Removing finalizer from manager role binding","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"name":"ubuntu-basic-gha-rs-manager"}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Removed finalizer from manager role binding","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"},"name":"ubuntu-basic-gha-rs-manager"}
{"severity":"info","ts":"2024-06-05T16:46:05Z","logger":"AutoscalingRunnerSet","message":"Waiting for dependent resources to be deleted","autoscalingrunnerset":{"name":"ubuntu-basic","namespace":"arc-scale-set-ubuntu-basic"}}
Can you please post values.yaml file with secret data redacted? What I'm guessing is happening is that you set the githubConfigSecret
in values.yaml file as string, and the secret couldn't be found on the release namespace (in your case, arc-scale-sets
). However, as you can see from the log, the resources are being cleaned up, but the process is slow. We already provided a fix for that issue that will be part of the next release.
I'm closing this issue now, but feel free to comment on it. Based on the log, everything is working as expected, and the only problem is that finalizing resources is taking too long, which is already fixed.
Checks
Controller Version
0.9.1
Deployment Method
Helm
Checks
To Reproduce
Describe the bug
helm delete does not delete all the resources.
Describe the expected behavior
I expect the helm delete to remove all resources without me having to manually remove finalizers.
Additional Context
Controller Logs
Runner Pod Logs