We are having issue after jenkins upgrade to the latest version. Below are the logs from jenkins.
===
Asked to provision 1 agent(s) for: plain_fargate
Feb 20, 2023 5:50:28 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSCloud provision
Will provision bes-01-ecs-plain_fargate-p0zp9, for label: plain_fargate
Feb 20, 2023 5:50:38 AM INFO hudson.slaves.NodeProvisioner update
bes-01-ecs-plain_fargate-p0zp9 provisioning successfully completed. We have now 2 computer(s)
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on tags: false
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on container definition: true
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on volumes: true
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on task role: true
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on execution role: true
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on network mode: true
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher runECSTask
[bes-01-ecs-plain_fargate-p0zp9]: Starting agent with task definition arn:aws:ecs:eu-central-1:296450026039:task-definition/bes-01-ecs-plain-template:6}
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher runECSTask
[bes-01-ecs-plain_fargate-p0zp9]: Agent started with task arn : arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask
[bes-01-ecs-plain_fargate-p0zp9]: TaskArn: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask
[bes-01-ecs-plain_fargate-p0zp9]: TaskDefinitionArn: arn:aws:ecs:eu-central-1:296450026039:task-definition/bes-01-ecs-plain-template:6
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask
[bes-01-ecs-plain_fargate-p0zp9]: ClusterArn: arn:aws:ecs:eu-central-1:296450026039:cluster/devops-jenkins-bes-01-ecs-cluster
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask
[bes-01-ecs-plain_fargate-p0zp9]: ContainerInstanceArn: null
Feb 20, 2023 5:51:01 AM WARNING org.jenkinsci.plugins.prometheus.DiskUsageCollector collect
Cannot collect disk usage data because plugin CloudBees Disk Usage Simple is not installed: java.lang.NoClassDefFoundError: com/cloudbees/simplediskusage/QuickDiskUsagePlugin
Feb 20, 2023 5:51:14 AM WARNING com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask
[bes-01-ecs-plain_fargate-p0zp9]: ECS Task stopped: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f
com.amazonaws.waiters.WaiterUnrecoverableException: Resource never entered the desired state as it failed.
at com.amazonaws.waiters.WaiterExecution.pollResource(WaiterExecution.java:78)
at com.amazonaws.waiters.WaiterImpl.run(WaiterImpl.java:88)
at com.cloudbees.jenkins.plugins.amazonecs.ECSService.waitForTasksRunning(ECSService.java:151)
at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launchECSTask(ECSLauncher.java:158)
at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launch(ECSLauncher.java:110)
at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:298)
at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:48)
at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:82)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Feb 20, 2023 5:51:14 AM WARNING com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launch
[bes-01-ecs-plain_fargate-p0zp9]: Error in provisioning; agent=com.cloudbees.jenkins.plugins.amazonecs.ECSSlave[bes-01-ecs-plain_fargate-p0zp9]
Also: java.lang.Throwable: launched here
at hudson.slaves.SlaveComputer._connect(SlaveComputer.java:287)
at hudson.model.Computer.connect(Computer.java:445)
at hudson.slaves.CloudRetentionStrategy.start(CloudRetentionStrategy.java:75)
at org.jenkinsci.plugins.durabletask.executors.OnceRetentionStrategy.start(OnceRetentionStrategy.java:83)
at org.jenkinsci.plugins.durabletask.executors.OnceRetentionStrategy.start(OnceRetentionStrategy.java:46)
at hudson.model.AbstractCIBase.createNewComputerForNode(AbstractCIBase.java:192)
at hudson.model.AbstractCIBase.updateNewComputer(AbstractCIBase.java:221)
at jenkins.model.Jenkins.updateNewComputer(Jenkins.java:1669)
at jenkins.model.Nodes.addNode(Nodes.java:146)
at jenkins.model.Jenkins.addNode(Jenkins.java:2211)
at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:248)
at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:823)
at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:94)
at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:69)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
java.lang.IllegalStateException: Task stopped before coming online. TaskARN: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f
at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launchECSTask(ECSLauncher.java:170)
at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launch(ECSLauncher.java:110)
at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:298)
at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:48)
at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:82)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Feb 20, 2023 5:51:14 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSSlave _terminate
[bes-01-ecs-plain_fargate-p0zp9]: Stopping: TaskArn arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f, ClusterArn arn:aws:ecs:eu-central-1:296450026039:cluster/devops-jenkins-bes-01-ecs-cluster
Feb 20, 2023 5:51:14 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService stopTask
Delete ECS agent task: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f
==========
Jenkins version: 2.375.3
Amazon Elastic Container Service (ECS) / Fargate pluginVersion: 1.47
Amazon Web Services SDK :: ECSVersion: 1.12.406-370.v8f993c987059
Hello Team,
We are having issue after jenkins upgrade to the latest version. Below are the logs from jenkins.
=== Asked to provision 1 agent(s) for: plain_fargate Feb 20, 2023 5:50:28 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSCloud provision Will provision bes-01-ecs-plain_fargate-p0zp9, for label: plain_fargate Feb 20, 2023 5:50:38 AM INFO hudson.slaves.NodeProvisioner update bes-01-ecs-plain_fargate-p0zp9 provisioning successfully completed. We have now 2 computer(s) Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate Match on tags: false Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate Match on container definition: true Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate Match on volumes: true Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate Match on task role: true Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate Match on execution role: true Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate Match on network mode: true Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher runECSTask [bes-01-ecs-plain_fargate-p0zp9]: Starting agent with task definition arn:aws:ecs:eu-central-1:296450026039:task-definition/bes-01-ecs-plain-template:6} Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher runECSTask [bes-01-ecs-plain_fargate-p0zp9]: Agent started with task arn : arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask [bes-01-ecs-plain_fargate-p0zp9]: TaskArn: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask [bes-01-ecs-plain_fargate-p0zp9]: TaskDefinitionArn: arn:aws:ecs:eu-central-1:296450026039:task-definition/bes-01-ecs-plain-template:6 Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask [bes-01-ecs-plain_fargate-p0zp9]: ClusterArn: arn:aws:ecs:eu-central-1:296450026039:cluster/devops-jenkins-bes-01-ecs-cluster Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask [bes-01-ecs-plain_fargate-p0zp9]: ContainerInstanceArn: null Feb 20, 2023 5:51:01 AM WARNING org.jenkinsci.plugins.prometheus.DiskUsageCollector collect Cannot collect disk usage data because plugin CloudBees Disk Usage Simple is not installed: java.lang.NoClassDefFoundError: com/cloudbees/simplediskusage/QuickDiskUsagePlugin Feb 20, 2023 5:51:14 AM WARNING com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask [bes-01-ecs-plain_fargate-p0zp9]: ECS Task stopped: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f com.amazonaws.waiters.WaiterUnrecoverableException: Resource never entered the desired state as it failed. at com.amazonaws.waiters.WaiterExecution.pollResource(WaiterExecution.java:78) at com.amazonaws.waiters.WaiterImpl.run(WaiterImpl.java:88) at com.cloudbees.jenkins.plugins.amazonecs.ECSService.waitForTasksRunning(ECSService.java:151) at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launchECSTask(ECSLauncher.java:158) at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launch(ECSLauncher.java:110) at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:298) at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:48) at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:82) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source)
Feb 20, 2023 5:51:14 AM WARNING com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launch [bes-01-ecs-plain_fargate-p0zp9]: Error in provisioning; agent=com.cloudbees.jenkins.plugins.amazonecs.ECSSlave[bes-01-ecs-plain_fargate-p0zp9] Also: java.lang.Throwable: launched here at hudson.slaves.SlaveComputer._connect(SlaveComputer.java:287) at hudson.model.Computer.connect(Computer.java:445) at hudson.slaves.CloudRetentionStrategy.start(CloudRetentionStrategy.java:75) at org.jenkinsci.plugins.durabletask.executors.OnceRetentionStrategy.start(OnceRetentionStrategy.java:83) at org.jenkinsci.plugins.durabletask.executors.OnceRetentionStrategy.start(OnceRetentionStrategy.java:46) at hudson.model.AbstractCIBase.createNewComputerForNode(AbstractCIBase.java:192) at hudson.model.AbstractCIBase.updateNewComputer(AbstractCIBase.java:221) at jenkins.model.Jenkins.updateNewComputer(Jenkins.java:1669) at jenkins.model.Nodes.addNode(Nodes.java:146) at jenkins.model.Jenkins.addNode(Jenkins.java:2211) at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:248) at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:823) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:94) at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:69) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) java.lang.IllegalStateException: Task stopped before coming online. TaskARN: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launchECSTask(ECSLauncher.java:170) at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launch(ECSLauncher.java:110) at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:298) at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:48) at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:82) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source)
Feb 20, 2023 5:51:14 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSSlave _terminate [bes-01-ecs-plain_fargate-p0zp9]: Stopping: TaskArn arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f, ClusterArn arn:aws:ecs:eu-central-1:296450026039:cluster/devops-jenkins-bes-01-ecs-cluster Feb 20, 2023 5:51:14 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService stopTask Delete ECS agent task: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f
==========
Jenkins version: 2.375.3 Amazon Elastic Container Service (ECS) / Fargate pluginVersion: 1.47 Amazon Web Services SDK :: ECSVersion: 1.12.406-370.v8f993c987059
Configuration details are below:
clouds:
Please help us to solve this issue.
Thanks. Thanks.