Open ohadcohenanjuna opened 7 months ago
To extend @ohadcohenanjuna description:
Got same behaviour. Issue seems to be in validation of template:
May 14, 2024 1:56:45 PM SEVERE com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate verifyTemplate
Error validating template
java.lang.NullPointerException: Cannot invoke "java.nio.file.Path.register(java.nio.file.WatchService, java.nio.file.WatchEvent$Kind[])" because the return value of "java.nio.file.Path.getParent()" is null
at com.sshtools.common.logger.FileWatchingService.register(FileWatchingService.java:76)
at com.sshtools.common.logger.DefaultLoggerContext.<init>(DefaultLoggerContext.java:61)
at com.sshtools.common.logger.Log.getDefaultContext(Log.java:38)
at com.sshtools.common.logger.Log.isLevelEnabled(Log.java:103)
at com.sshtools.common.logger.Log.isInfoEnabled(Log.java:87)
at com.sshtools.common.ssh.components.jce.JCEProvider.enableBouncyCastle(JCEProvider.java:237)
at com.sshtools.common.ssh.components.jce.JCEComponentManager.<init>(JCEComponentManager.java:110)
at com.sshtools.common.ssh.components.ComponentManager.getInstance(ComponentManager.java:131)
Caused: java.lang.RuntimeException: Unable to locate a cryptographic provider
at com.sshtools.common.ssh.components.ComponentManager.getInstance(ComponentManager.java:135)
at com.sshtools.common.publickey.OpenSSHPrivateKeyFile.getRSAKeyPair(OpenSSHPrivateKeyFile.java:608)
at com.sshtools.common.publickey.OpenSSHPrivateKeyFile.toKeyPair(OpenSSHPrivateKeyFile.java:158)
at com.sshtools.common.publickey.SshKeyUtils.getPrivateKey(SshKeyUtils.java:113)
at com.microsoft.azure.vmagent.util.KeyDecoder.getPublicKey(KeyDecoder.java:17)
at com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate.verifySSHKey(AzureVMManagementServiceDelegate.java:2454)
at com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate.verifyTemplate(AzureVMManagementServiceDelegate.java:2070)
at com.microsoft.azure.vmagent.AzureVMAgentTemplate.verifyTemplate(AzureVMAgentTemplate.java:1405)
at com.microsoft.azure.vmagent.AzureVMCloudVerificationTask.verify(AzureVMCloudVerificationTask.java:83)
at com.microsoft.azure.vmagent.AzureVMCloud.provision(AzureVMCloud.java:628)
at hudson.slaves.NodeProvisioner$StandardStrategyImpl.apply(NodeProvisioner.java:726)
at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:325)
at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:823)
at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:92)
at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:67)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Any suggestions ?
we started also having the same issue after the last plugin update and our guess is that this is an issue with a dependency of the plugin, specifically this issue: https://github.com/sshtools/maverick-synergy/issues/86
which was introduced by https://github.com/jenkinsci/azure-vm-agents-plugin/pull/507
Any specific steps to reproduce or key types needed?
we are using ssh keys generated by ssh-keygen ( rsa key 4096 bytes )
I've tried with:
ssh-keygen -t rsa -b 4096 -m PEM
On each of them I've tried:
I didn't hit any issues
Is it possible to create a minimal reproduction?
I've tried this on:
Java 11 and Java 21 Jenkins 2.452.1 All latest plugins
Could you provide a full plugin list? Its possible you have a dependency conflict and the dependency update exposed it.
I can't see any other plugin using this dependency though
I can't post it publicly here for security reasons :(
this is a list of plugins where we have seen the issue
analysis-model-api:12.3.0
ansicolor:1.0.4
ant:497.v94e7d9fffa_b_9
antisamy-markup-formatter:162.v0e6ec0fcfcf6
apache-httpcomponents-client-4-api:4.5.14-208.v438351942757
apache-httpcomponents-client-5-api:5.3.1-1.0
artifactory:4.0.6
asm-api:9.7-33.v4d23ef79fcc8
audit-trail:361.v82cde86c784e
authentication-tokens:1.53.v1c90fd9191a_b_
authorize-project:1.7.1
azure-credentials:312.v0f3973cd1e59
azure-keyvault:251.vcfe31c013dc7
azure-sdk:157.v855da_0b_eb_dc2
azure-vm-agents:921.v76424a_e24594
basic-branch-build-strategies:81.v05e333931c7d
bitbucket-build-status-notifier:1.4.2
bitbucket-push-and-pull-request:3.0.2
blueocean-autofavorite:1.2.5
blueocean-bitbucket-pipeline:1.27.12
blueocean-commons:1.27.12
blueocean-config:1.27.12
blueocean-core-js:1.27.12
blueocean-dashboard:1.27.12
blueocean-display-url:2.4.2
blueocean-events:1.27.12
blueocean-git-pipeline:1.27.12
blueocean-github-pipeline:1.27.12
blueocean-i18n:1.27.12
blueocean-jwt:1.27.12
blueocean-personalization:1.27.12
blueocean-pipeline-api-impl:1.27.12
blueocean-pipeline-editor:1.27.12
blueocean-pipeline-scm-api:1.27.12
blueocean-rest-impl:1.27.12
blueocean-rest:1.27.12
blueocean-web:1.27.12
blueocean:1.27.12
bootstrap5-api:5.3.3-1
bouncycastle-api:2.30.1.77-225.v26ea_c9455fd9
branch-api:2.1163.va_f1064e4a_a_f3
build-discarder:139.v05696a_7fe240
build-timeout:1.32
caffeine-api:3.1.8-133.v17b_1ff2e0599
checks-api:2.2.0
cloud-stats:336.v788e4055508b_
cloudbees-bitbucket-branch-source:883.v041fa_695e9c2
cloudbees-disk-usage-simple:203.v3f46a_7462b_1a_
cloudbees-folder:6.901.vb_4c7a_da_75da_3
cobertura:1.17
code-coverage-api:4.99.0
command-launcher:107.v773860566e2e
commons-lang3-api:3.13.0-62.v7d18e55f51e2
commons-text-api:1.11.0-109.vfe16c66636eb_
conditional-buildstep:1.4.3
config-file-provider:973.vb_a_80ecb_9a_4d0
configuration-as-code-groovy:1.1
configuration-as-code:1775.v810dc950b_514
coverage:1.14.0
credentials-binding:657.v2b_19db_7d6e6d
credentials:1337.v60b_d7b_c7b_c9f
dashboard-view:2.508.va_74654f026d1
data-tables-api:2.0.5-1
display-url-api:2.200.vb_9327d658781
docker-commons:439.va_3cb_0a_6a_fb_29
docker-workflow:572.v950f58993843
dtkit-api:3.0.2
durable-task:555.v6802fe0f0b_82
echarts-api:5.5.0-1
email-ext:1806.v856a_01a_fa_39a_
external-monitor-job:215.v2e88e894db_f8
favorite:2.208.v91d65b_7792a_c
font-awesome-api:6.5.2-1
forensics-api:2.4.0
generic-webhook-trigger:2.2.0
git-client:4.7.0
git-forensics:2.1.0
git-server:114.v068a_c7cc2574
git:5.2.1
github-api:1.318-461.v7a_c09c9fa_d63
github-branch-source:1787.v8b_8cd49a_f8f1
github:1.38.0
gradle:2.11
greenballs:1.15.1
groovy:457.v99900cb_85593
gson-api:2.10.1-15.v0d99f670e0a_7
handy-uri-templates-2-api:2.1.8-30.v7e777411b_148
hashicorp-vault-plugin:367.v8a_1ee1cccf3a
htmlpublisher:1.33
instance-identity:185.v303dc7c645f9
ionicons-api:70.v2959a_b_74e3cf
jackson2-api:2.17.0-379.v02de8ec9f64c
jacoco:3.3.6
jakarta-activation-api:2.1.3-1
jakarta-mail-api:2.1.3-1
javadoc:243.vb_b_503b_b_45537
javax-activation-api:1.2.0-6
jaxb:2.3.9-1
jenkins-design-language:1.27.12
jersey2-api:2.42-147.va_28a_44603b_d5
jjwt-api:0.11.5-112.ve82dfb_224b_a_d
job-dsl:1.87
job-restrictions:0.8
jobConfigHistory:1229.v3039470161a_d
joda-time-api:2.12.7-29.v5a_b_e3a_82269a_
jquery3-api:3.7.1-2
jsch:0.2.16-86.v42e010d9484b_
json-api:20240303-41.v94e11e6de726
json-path-api:2.9.0-58.v62e3e85b_a_655
junit:1265.v65b_14fa_f12f0
kubernetes-client-api:6.10.0-240.v57880ce8b_0b_2
kubernetes-credentials:0.11
kubernetes-pipeline-devops-steps:1.6
kubernetes:4203.v1dd44f5b_1cf9
ldap:725.v3cb_b_711b_1a_ef
locale:431.v3435fa_8f8445
lockable-resources:1246.v28b_e4cc6fa_16
mailer:472.vf7c289a_4b_420
mask-passwords:173.v6a_077a_291eb_5
matrix-auth:3.2.2
matrix-groovy-execution-strategy:1.0.8
matrix-project:822.824.v14451b_c0fd42
maven-plugin:3.23
mercurial:1260.vdfb_723cdcc81
metrics:4.2.21-449.v6960d7c54c69
mina-sshd-api-common:2.12.1-101.v85b_e08b_780dd
mina-sshd-api-core:2.12.1-101.v85b_e08b_780dd
multibranch-scan-webhook-trigger:1.0.11
multiple-scms:0.8
oic-auth:4.250.v5a_d993226437
okhttp-api:4.11.0-172.vda_da_1feeb_c6e
pam-auth:1.10
parameterized-scheduler:262.v00f3d90585cc
parameterized-trigger:787.v665fcf2a_830b_
parasoft-findings:10.7.1
performance:957.v658a_7065b_92a_
pipeline-build-step:540.vb_e8849e1a_b_d8
pipeline-graph-analysis:216.vfd8b_ece330ca_
pipeline-graph-view:241.v3d46398a_328c
pipeline-groovy-lib:704.vc58b_8890a_384
pipeline-input-step:495.ve9c153f6067b_
pipeline-milestone-step:119.vdfdc43fc3b_9a_
pipeline-model-api:2.2198.v41dd8ef6dd56
pipeline-model-declarative-agent:1.1.1
pipeline-model-definition:2.2198.v41dd8ef6dd56
pipeline-model-extensions:2.2198.v41dd8ef6dd56
pipeline-rest-api:2.34
pipeline-stage-step:312.v8cd10304c27a_
pipeline-stage-tags-metadata:2.2198.v41dd8ef6dd56
pipeline-stage-view:2.34
pipeline-utility-steps:2.16.2
plain-credentials:179.vc5cb_98f6db_38
plugin-util-api:4.1.0
prism-api:1.29.0-13
prometheus:763.vf8c26b_a_34b_d6
pubsub-light:1.18
rebuild:332.va_1ee476d8f6d
remote-file:1.24
resource-disposer:0.23
rich-text-publisher-plugin:1.5
rocketchatnotifier:1.5.2
role-strategy:717.v6a_69a_fe98974
run-condition:1.7
schedule-build:559.ve9fb_2e719354
scm-api:690.vfc8b_54395023
script-security:1335.vf07d9ce377a_e
sidebar-link:2.4.1
simple-theme-plugin:176.v39740c03a_a_f5
skip-notifications-trait:313.vd1337c8f8134
snakeyaml-api:2.2-111.vc6598e30cc65
sse-gateway:1.26
ssh-agent:367.vf9076cd4ee21
ssh-credentials:337.v395d2403ccd4
ssh-slaves:2.948.vb_8050d697fec
sshd:3.322.v159e91f6a_550
startup-trigger-plugin:2.9.4
structs:337.v1b_04ea_4df7c8
test-results-analyzer:0.4.1
text-finder:1.26
thinBackup:2.0
timestamper:1.26
token-macro:400.v35420b_922dcb_
trilead-api:2.142.v748523a_76693
variant:60.v7290fc0eb_b_cd
warnings-ng:11.3.0
windows-slaves:1.8.1
workflow-aggregator:596.v8c21c963d92d
workflow-api:1291.v51fd2a_625da_7
workflow-basic-steps:1049.v257a_e6b_30fb_d
workflow-cps-global-lib:612.v55f2f80781ef
workflow-cps:3894.vd0f0248b_a_fc4
workflow-durable-task-step:1336.v768003e07199
workflow-job:1400.v7fd111b_ec82f
workflow-multibranch:773.vc4fe1378f1d5
workflow-scm-step:427.v4ca_6512e7df1
workflow-step-api:657.v03b_e8115821b_
workflow-support:896.v175a_a_9c5b_78f
ws-cleanup:0.45
xunit:3.1.4
and this is an SBOM of the jenkins image: sbom.txt
Thanks I’ll try reproduce with that list ~next week
I wasn't able to reproduce it with that list =/
In addition to @ysmaoui maybe there could be an issue with the specific template used as casc:
jenkins:
clouds:
- azureVM:
azureCredentialsId: "az-vm-sp"
deploymentTimeout: 1200
existingResourceGroupName: "rg-test-1"
maxVirtualMachinesLimit: 16
name: "VM-Cloud"
resourceGroupReferenceType: "existing"
vmTemplates:
- templateName: "docker"
builtInImage: "Ubuntu 22.04 LTS"
credentialsId: "ssh-jenkins"
diskType: "managed"
doNotUseMachineIfInitFails: false
executeInitScriptAsRoot: false
existingStorageAccountName: "satestjenkinsjj001"
imageReference:
galleryImageDefinition: "docker"
galleryImageSpecialized: true
galleryImageVersion: "1.0.0"
galleryName: "sig_test_jenkins"
galleryResourceGroup: "rg-test-1"
gallerySubscriptionId: "xxx hidden xxx"
imageTopLevelType: "advanced"
installGit: true
javaPath: "java"
labels: "docker"
launcher:
ssh:
sshConfig: |-
Host 192.168*
HostkeyAlgorithms +ssh-rsa
PubkeyAcceptedAlgorithms +ssh-rsa
location: "West Europe"
maxVirtualMachinesLimit: 4
maximumDeploymentSize: 4
noOfParallelJobs: 1
osDiskSize: 512
osDiskStorageAccountType: "Standard_LRS"
osType: "Linux"
retentionStrategy: "azureVMCloudOnce"
storageAccountNameReferenceType: "existing"
storageAccountType: "Standard_LRS"
subnetName: "snet-jenkins-vms"
usageMode: NORMAL
usePrivateIP: true
virtualMachineSize: "Standard_F16s_v2"
virtualNetworkName: "vnet-jenkins-test"
virtualNetworkResourceGroupName: "rg-test-1"
tags:
- name: "JenkinsVMType"
value: "docker"
I had the same problem with plugin version 933.v440f85ced646 Had to revert to old version.
Hi, as an update, it seems like the new agent version released a few days ago does work. So this might be able to be resolved.
Interesting, thanks for the update
Hi @timja, we are still getting the issue with the latest version 948.v0b_47dc66677e
it is working for us with 901.ved986df424b_3
any thoughts what could be the issue?
Full stack trace
Error validating template
java.lang.NullPointerException: Cannot invoke "java.nio.file.Path.register(java.nio.file.WatchService, java.nio.file.WatchEvent$Kind[])" because the return value of "java.nio.file.Path.getParent()" is null
at PluginClassLoader for azure-vm-agents//com.sshtools.common.logger.FileWatchingService.register(FileWatchingService.java:76)
at PluginClassLoader for azure-vm-agents//com.sshtools.common.logger.DefaultLoggerContext.<init>(DefaultLoggerContext.java:61)
at PluginClassLoader for azure-vm-agents//com.sshtools.common.logger.Log.getDefaultContext(Log.java:38)
at PluginClassLoader for azure-vm-agents//com.sshtools.common.logger.Log.isLevelEnabled(Log.java:103)
at PluginClassLoader for azure-vm-agents//com.sshtools.common.logger.Log.isInfoEnabled(Log.java:87)
at PluginClassLoader for azure-vm-agents//com.sshtools.common.ssh.components.jce.JCEProvider.enableBouncyCastle(JCEProvider.java:237)
at PluginClassLoader for azure-vm-agents//com.sshtools.common.ssh.components.jce.JCEComponentManager.<init>(JCEComponentManager.java:110)
at PluginClassLoader for azure-vm-agents//com.sshtools.common.ssh.components.ComponentManager.getInstance(ComponentManager.java:131)
Caused: java.lang.RuntimeException: Unable to locate a cryptographic provider
at PluginClassLoader for azure-vm-agents//com.sshtools.common.ssh.components.ComponentManager.getInstance(ComponentManager.java:135)
at PluginClassLoader for azure-vm-agents//com.sshtools.common.publickey.OpenSSHPrivateKeyFile.getRSAKeyPair(OpenSSHPrivateKeyFile.java:608)
at PluginClassLoader for azure-vm-agents//com.sshtools.common.publickey.OpenSSHPrivateKeyFile.toKeyPair(OpenSSHPrivateKeyFile.java:158)
at PluginClassLoader for azure-vm-agents//com.sshtools.common.publickey.SshKeyUtils.getPrivateKey(SshKeyUtils.java:113)
at PluginClassLoader for azure-vm-agents//com.microsoft.azure.vmagent.util.KeyDecoder.getPublicKey(KeyDecoder.java:17)
at PluginClassLoader for azure-vm-agents//com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate.verifySSHKey(AzureVMManagementServiceDelegate.java:2514)
at PluginClassLoader for azure-vm-agents//com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate.verifyTemplate(AzureVMManagementServiceDelegate.java:2130)
at PluginClassLoader for azure-vm-agents//com.microsoft.azure.vmagent.AzureVMAgentTemplate$DescriptorImpl.doVerifyConfiguration(AzureVMAgentTemplate.java:2039)
at java.base/java.lang.invoke.MethodHandle.invokeWithArguments(MethodHandle.java:732)
at org.kohsuke.stapler.Function$MethodFunction.invoke(Function.java:416)
at org.kohsuke.stapler.Function$InstanceFunction.invoke(Function.java:429)
at org.kohsuke.stapler.Function.bindAndInvoke(Function.java:211)
at org.kohsuke.stapler.SelectionInterceptedFunction$Adapter.invoke(SelectionInterceptedFunction.java:37)
at org.kohsuke.stapler.verb.HttpVerbInterceptor.invoke(HttpVerbInterceptor.java:48)
at org.kohsuke.stapler.SelectionInterceptedFunction.bindAndInvoke(SelectionInterceptedFunction.java:26)
at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:138)
at org.kohsuke.stapler.MetaClass$11.doDispatch(MetaClass.java:644)
at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:61)
at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:827)
at org.kohsuke.stapler.Stapler.invoke(Stapler.java:965)
at org.kohsuke.stapler.MetaClass$4.doDispatch(MetaClass.java:327)
at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:61)
at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:827)
at org.kohsuke.stapler.Stapler.invoke(Stapler.java:965)
at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:898)
at org.kohsuke.stapler.Stapler.invoke(Stapler.java:965)
at org.kohsuke.stapler.MetaClass$9.dispatch(MetaClass.java:548)
at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:827)
at org.kohsuke.stapler.Stapler.invoke(Stapler.java:965)
at org.kohsuke.stapler.Stapler.invoke(Stapler.java:747)
at org.kohsuke.stapler.Stapler.service(Stapler.java:253)
at Jenkins Main ClassLoader//javax.servlet.http.HttpServlet.service(HttpServlet.java:590)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:764)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1665)
at com.cloudbees.jenkins.ha.HAHealthCheckFilter.doFilter(HAHealthCheckFilter.java:35)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:210)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:163)
at PluginClassLoader for splunk-devops//com.splunk.splunkjenkins.WebPostAccessLogger.doFilter(WebPostAccessLogger.java:39)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for cors-filter//org.jenkinsci.plugins.corsfilter.AccessControlsFilter.doFilter(AccessControlsFilter.java:79)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for cloudbees-support//com.cloudbees.jenkins.support.impl.cloudbees.UnrestrictedApiCallsMonitor$ApiMonitorFilter.doFilter(UnrestrictedApiCallsMonitor.java:124)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for cloudbees-analytics//com.cloudbees.analytics.gatherer.InboundLink$1.doFilter(InboundLink.java:118)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for sse-gateway//org.jenkinsci.plugins.ssegateway.Endpoint$SSEListenChannelFilter.doFilter(Endpoint.java:248)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for blueocean-jwt//io.jenkins.blueocean.auth.jwt.impl.JwtAuthenticationFilter.doFilter(JwtAuthenticationFilter.java:60)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for support-core//com.cloudbees.jenkins.support.slowrequest.SlowRequestFilter.doFilter(SlowRequestFilter.java:37)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for cloudbees-request-filter//com.cloudbees.jenkins.plugins.requestfilter.BlockingFilter.doFilter(BlockingFilter.java:78)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for operations-center-client//com.cloudbees.opscenter.client.plugin.OfflineSecurityRealmFilter._doFilter(OfflineSecurityRealmFilter.java:123)
at PluginClassLoader for operations-center-client//com.cloudbees.opscenter.client.plugin.OfflineSecurityRealmFilter.doFilter(OfflineSecurityRealmFilter.java:75)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for operations-center-context//com.cloudbees.opscenter.security.ClusterSessionFilter._doFilter(ClusterSessionFilter.java:67)
at PluginClassLoader for operations-center-context//com.cloudbees.opscenter.security.ClusterSessionFilter.doFilter(ClusterSessionFilter.java:42)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for blueocean-web//io.jenkins.blueocean.ResourceCacheControl.doFilter(ResourceCacheControl.java:134)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for monitoring//net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:239)
at PluginClassLoader for monitoring//net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:215)
at PluginClassLoader for monitoring//net.bull.javamelody.PluginMonitoringFilter.doFilter(PluginMonitoringFilter.java:88)
at PluginClassLoader for monitoring//org.jvnet.hudson.plugins.monitoring.HudsonMonitoringFilter.doFilter(HudsonMonitoringFilter.java:121)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for cloudbees-analytics//com.cloudbees.analytics.gatherer.SetupWizardStepsFilter.doFilter(SetupWizardStepsFilter.java:203)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at PluginClassLoader for metrics//jenkins.metrics.impl.MetricsFilter.doFilter(MetricsFilter.java:125)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at jenkins.util.HttpServletFilter$1.doFilter(HttpServletFilter.java:76)
at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:160)
at hudson.util.PluginServletFilter.doFilter(PluginServletFilter.java:166)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
at jenkins.ErrorAttributeFilter.doFilter(ErrorAttributeFilter.java:29)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
at hudson.security.csrf.CrumbFilter.doFilter(CrumbFilter.java:118)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:94)
at jenkins.security.AcegiSecurityExceptionFilter.doFilter(AcegiSecurityExceptionFilter.java:52)
at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:99)
at hudson.security.UnwrapSecurityExceptionFilter.doFilter(UnwrapSecurityExceptionFilter.java:54)
at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:99)
at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:126)
at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:120)
at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:99)
at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:100)
at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:99)
at org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:110)
at org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:101)
at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:99)
at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:227)
at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:221)
at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:99)
at jenkins.security.BasicHeaderProcessor.doFilter(BasicHeaderProcessor.java:97)
at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:99)
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:117)
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
at hudson.security.HttpSessionContextIntegrationFilter2.doFilter(HttpSessionContextIntegrationFilter2.java:63)
at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:99)
at hudson.security.ChainedServletFilter.doFilter(ChainedServletFilter.java:111)
at hudson.security.HudsonFilter.doFilter(HudsonFilter.java:172)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
at org.kohsuke.stapler.compression.CompressionFilter.doFilter(CompressionFilter.java:53)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
at hudson.util.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:86)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
at org.kohsuke.stapler.DiagnosticThreadNameFilter.doFilter(DiagnosticThreadNameFilter.java:31)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
at jenkins.security.SuspiciousRequestFilter.doFilter(SuspiciousRequestFilter.java:38)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:131)
at Jenkins Main ClassLoader//org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:569)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:223)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1580)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1384)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)
at Jenkins Main ClassLoader//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1553)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1306)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:46)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.Server.handle(Server.java:563)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.HttpChannel$RequestDispatchable.dispatch(HttpChannel.java:1598)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:753)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:501)
at Jenkins Main ClassLoader//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:287)
at Jenkins Main ClassLoader//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)
at Jenkins Main ClassLoader//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)
at Jenkins Main ClassLoader//org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)
at Jenkins Main ClassLoader//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:421)
at Jenkins Main ClassLoader//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:390)
at Jenkins Main ClassLoader//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:277)
at Jenkins Main ClassLoader//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:199)
at Jenkins Main ClassLoader//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:411)
at Jenkins Main ClassLoader//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
at Jenkins Main ClassLoader//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
at Jenkins Main ClassLoader//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
at java.base/java.lang.Thread.run(Thread.java:840)
No I spent awhile trying to reproduce it and was not able to.
Jenkins and plugins versions report
Jenkins Version: Jenkins 2.440.3. (can confirm also a problem on 2.440.2) Azure VM Agent: working: 901.ved986df424b_3 not working: 921.v76424a_e24594
What Operating System are you using (both controller, and any agents involved in the problem)?
Agents are Ubuntu machines; the controller is a docker image running on AWS Linux2. the docker image is: jenkins:lts-jdk21
Reproduction steps
After upgrade and restart of the Jenkins server, jobs are just waiting for agents but the plugin does not kick in, nothing in the logs (so it seems that the plugin is not seeing jobs are pending at all).
Expected Results
Agents would spin when jobs are pending,
Actual Results
nothing happens. no longs, just jobs in the queue and no new agents
Anything else?
Downgrading the plugin fixed the issue.
Are you interested in contributing a fix?
No response