jenkinsci / azure-storage-plugin

21 stars 45 forks source link

Large file upload fails after updating from 1.1.7 to 355.v4da08e72a251 #188

Closed FP-Dmytro-B closed 3 years ago

FP-Dmytro-B commented 3 years ago

Version report

Jenkins and plugins versions report:

Jenkins: 2.277.2
OS: Windows Server 2019 - 10.0
---
ace-editor:1.1
ant:1.11
antisamy-markup-formatter:2.1
apache-httpcomponents-client-4-api:4.5.13-1.0
authentication-tokens:1.4
authorize-project:1.4.0
aws-java-sdk:1.11.995
azure-ad:155.v745ce80af7ea
azure-commons:1.1.3
azure-credentials:181.v00b0d97d2686
azure-sdk:7.va79ea0a60157
blueocean-commons:1.24.6
blueocean-rest:1.24.6
bootstrap4-api:4.6.0-3
bouncycastle-api:2.20
branch-api:2.6.4
build-timeout:1.20
change-assembly-version-plugin:1.10
checks-api:1.7.0
cloudbees-folder:6.15
command-launcher:1.5
conditional-buildstep:1.4.1
config-autorefresh-plugin:1.0
copyartifact:1.46
credentials-binding:1.24
credentials:2.3.18
cvs:2.18
dashboard-view:2.15
dependency-check-jenkins-plugin:5.1.1
display-url-api:2.3.4
docker-commons:1.17
docker-workflow:1.26
durable-task:1.36
echarts-api:5.1.0-2
email-ext:2.82
embeddable-build-status:2.0.3
envinject-api:1.7
envinject:2.4.0
external-monitor-job:1.7
font-awesome-api:5.15.2-2
git-client:3.7.1
git-parameter:0.9.13
git-server:1.9
git:4.7.1
greenballs:1.15.1
handlebars:3.0.8
htmlpublisher:1.25
jackson2-api:2.12.3
javadoc:1.6
jdk-tool:1.5
jobConfigHistory:2.27
jquery-detached:1.2.1
jquery:1.12.4-1
jquery3-api:3.6.0-1
jsch:0.1.55.2
junit:1.49
ldap:2.6
lockable-resources:2.10
mailer:1.34
matrix-auth:2.6.6
matrix-project:1.18
maven-plugin:3.10
momentjs:1.1.1
msbuild:1.30
next-build-number:1.6
pam-auth:1.6
parameterized-trigger:2.40
pipeline-build-step:2.13
pipeline-graph-analysis:1.10
pipeline-input-step:2.12
pipeline-milestone-step:1.3.2
pipeline-model-api:1.8.4
pipeline-model-definition:1.8.4
pipeline-model-extensions:1.8.4
pipeline-rest-api:2.19
pipeline-stage-step:2.5
pipeline-stage-tags-metadata:1.8.4
pipeline-stage-view:2.19
pipeline-utility-steps:2.7.1
plain-credentials:1.7
plugin-util-api:2.2.0
popper-api:1.16.1-2
powershell:1.5
rebuild:1.32
resource-disposer:0.15
run-condition:1.5
s3:0.11.6
scm-api:2.6.4
script-security:1.76
sectioned-view:1.25
snakeyaml-api:1.27.0
ssh-credentials:1.18.1
structs:1.22
thinBackup:1.10
timestamper:1.12
token-macro:2.15
trilead-api:1.0.13
uno-choice:2.5.6
versionnumber:1.9
windows-azure-storage:355.v4da08e72a251
windows-slaves:1.7
workflow-aggregator:2.6
workflow-api:2.42
workflow-basic-steps:2.23
workflow-cps-global-lib:2.19
workflow-cps:2.90
workflow-durable-task-step:2.38
workflow-job:2.40
workflow-multibranch:2.23
workflow-scm-step:2.12
workflow-step-api:2.23
workflow-support:3.8
ws-cleanup:0.39
Windows Server 2019 with all latest updates. No desktop experience.

Reproduction steps

Results

Expected result:

File uploaded.

Actual result:

The job hangs infinitely. No output in job console. Jenkins System log shows the following errors (Storage account name and IP ommited by me):

[id: 0x773478db, L:/172.17.0.4:65304 - R:<STORAGE_NAME_HERE>.blob.core.windows.net/<STORAGE_IP_HERE>:443] Error was received while reading the incoming data. The connection will be closed.
java.lang.NoSuchMethodError: org.codehaus.stax2.XMLStreamWriter2.closeCompletely()V
    at com.fasterxml.jackson.dataformat.xml.ser.ToXmlGenerator.close(ToXmlGenerator.java:1309)
    at com.fasterxml.jackson.databind.ObjectMapper._writeValueAndClose(ObjectMapper.java:4492)
    at com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3701)
    at com.azure.core.util.serializer.JacksonAdapter.serialize(JacksonAdapter.java:234)
    at com.azure.core.http.rest.RestProxy.configRequest(RestProxy.java:304)
    at com.azure.core.http.rest.RestProxy.createHttpRequest(RestProxy.java:238)
    at com.azure.core.http.rest.RestProxy.invoke(RestProxy.java:125)
    at com.sun.proxy.$Proxy86.commitBlockList(Unknown Source)
    at com.azure.storage.blob.implementation.BlockBlobsImpl.commitBlockListWithResponseAsync(BlockBlobsImpl.java:921)
    at com.azure.storage.blob.specialized.BlockBlobAsyncClient.commitBlockListWithResponse(BlockBlobAsyncClient.java:756)
    at com.azure.storage.blob.specialized.BlockBlobAsyncClient.lambda$commitBlockListWithResponse$10(BlockBlobAsyncClient.java:743)
    at com.azure.core.util.FluxUtil.lambda$withContext$5(FluxUtil.java:251)
    at reactor.core.publisher.MonoDeferContextual.subscribe(MonoDeferContextual.java:47)
    at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.drain(MonoIgnoreThen.java:154)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.ignoreDone(MonoIgnoreThen.java:191)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreInner.onComplete(MonoIgnoreThen.java:248)
    at reactor.core.publisher.FluxFlatMap$FlatMapMain.checkTerminated(FluxFlatMap.java:845)
    at reactor.core.publisher.FluxFlatMap$FlatMapMain.drainLoop(FluxFlatMap.java:607)
    at reactor.core.publisher.FluxFlatMap$FlatMapMain.innerComplete(FluxFlatMap.java:916)
    at reactor.core.publisher.FluxFlatMap$FlatMapInner.onComplete(FluxFlatMap.java:1020)
    at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onComplete(FluxMapFuseable.java:150)
    at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1816)
    at reactor.core.publisher.MonoFlatMap$FlatMapInner.onNext(MonoFlatMap.java:249)
    at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1815)
    at reactor.core.publisher.MonoIgnoreThen$ThenAcceptInner.onNext(MonoIgnoreThen.java:305)
    at reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onNext(FluxSwitchIfEmpty.java:73)
    at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:120)
    at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1815)
    at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.signalCached(MonoCacheTime.java:328)
    at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.onNext(MonoCacheTime.java:345)
    at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79)
    at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1815)
    at reactor.core.publisher.MonoCallable.subscribe(MonoCallable.java:61)
    at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64)
    at reactor.core.publisher.MonoCacheTime.subscribeOrReturn(MonoCacheTime.java:134)
    at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:57)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.drain(MonoIgnoreThen.java:154)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.ignoreDone(MonoIgnoreThen.java:191)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreInner.onComplete(MonoIgnoreThen.java:248)
    at reactor.core.publisher.MonoIgnoreElements$IgnoreElementsSubscriber.onComplete(MonoIgnoreElements.java:88)
    at reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:142)
    at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onComplete(FluxDoFinally.java:145)
    at reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:142)
    at reactor.netty.channel.FluxReceive.onInboundComplete(FluxReceive.java:389)
    at reactor.netty.channel.ChannelOperations.onInboundComplete(ChannelOperations.java:396)
    at reactor.netty.channel.ChannelOperations.terminate(ChannelOperations.java:452)
    at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:684)
    at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:94)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
    at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
    at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296)
    at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
    at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1534)
    at io.netty.handler.ssl.SslHandler.decodeNonJdkCompatible(SslHandler.java:1295)
    at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1332)
    at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:508)
    at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:447)
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
    at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
    at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
    at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719)
    at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655)
    at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581)
    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
    at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
    at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    at java.lang.Thread.run(Thread.java:748)

May 11, 2021 5:04:46 PM WARNING io.netty.channel.AbstractChannelHandlerContext invokeExceptionCaught

An exception 'java.lang.NoSuchMethodError: org.codehaus.stax2.XMLStreamWriter2.closeCompletely()V' [enable DEBUG level for full stacktrace] was thrown by a user handler's exceptionCaught() method while handling the following exception:
java.lang.NoSuchMethodError: org.codehaus.stax2.XMLStreamWriter2.closeCompletely()V
    at com.fasterxml.jackson.dataformat.xml.ser.ToXmlGenerator.close(ToXmlGenerator.java:1309)
    at com.fasterxml.jackson.databind.ObjectMapper._writeValueAndClose(ObjectMapper.java:4492)
    at com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3701)
    at com.azure.core.util.serializer.JacksonAdapter.serialize(JacksonAdapter.java:234)
    at com.azure.core.http.rest.RestProxy.configRequest(RestProxy.java:304)
    at com.azure.core.http.rest.RestProxy.createHttpRequest(RestProxy.java:238)
    at com.azure.core.http.rest.RestProxy.invoke(RestProxy.java:125)
    at com.sun.proxy.$Proxy86.commitBlockList(Unknown Source)
    at com.azure.storage.blob.implementation.BlockBlobsImpl.commitBlockListWithResponseAsync(BlockBlobsImpl.java:921)
    at com.azure.storage.blob.specialized.BlockBlobAsyncClient.commitBlockListWithResponse(BlockBlobAsyncClient.java:756)
    at com.azure.storage.blob.specialized.BlockBlobAsyncClient.lambda$commitBlockListWithResponse$10(BlockBlobAsyncClient.java:743)
    at com.azure.core.util.FluxUtil.lambda$withContext$5(FluxUtil.java:251)
    at reactor.core.publisher.MonoDeferContextual.subscribe(MonoDeferContextual.java:47)
    at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.drain(MonoIgnoreThen.java:154)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.ignoreDone(MonoIgnoreThen.java:191)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreInner.onComplete(MonoIgnoreThen.java:248)
    at reactor.core.publisher.FluxFlatMap$FlatMapMain.checkTerminated(FluxFlatMap.java:845)
    at reactor.core.publisher.FluxFlatMap$FlatMapMain.drainLoop(FluxFlatMap.java:607)
    at reactor.core.publisher.FluxFlatMap$FlatMapMain.innerComplete(FluxFlatMap.java:916)
    at reactor.core.publisher.FluxFlatMap$FlatMapInner.onComplete(FluxFlatMap.java:1020)
    at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onComplete(FluxMapFuseable.java:150)
    at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1816)
    at reactor.core.publisher.MonoFlatMap$FlatMapInner.onNext(MonoFlatMap.java:249)
    at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1815)
    at reactor.core.publisher.MonoIgnoreThen$ThenAcceptInner.onNext(MonoIgnoreThen.java:305)
    at reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onNext(FluxSwitchIfEmpty.java:73)
    at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:120)
    at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1815)
    at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.signalCached(MonoCacheTime.java:328)
    at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.onNext(MonoCacheTime.java:345)
    at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79)
    at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1815)
    at reactor.core.publisher.MonoCallable.subscribe(MonoCallable.java:61)
    at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64)
    at reactor.core.publisher.MonoCacheTime.subscribeOrReturn(MonoCacheTime.java:134)
    at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:57)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.drain(MonoIgnoreThen.java:154)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.ignoreDone(MonoIgnoreThen.java:191)
    at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreInner.onComplete(MonoIgnoreThen.java:248)
    at reactor.core.publisher.MonoIgnoreElements$IgnoreElementsSubscriber.onComplete(MonoIgnoreElements.java:88)
    at reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:142)
    at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onComplete(FluxDoFinally.java:145)
    at reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:142)
    at reactor.netty.channel.FluxReceive.onInboundComplete(FluxReceive.java:389)
    at reactor.netty.channel.ChannelOperations.onInboundComplete(ChannelOperations.java:396)
    at reactor.netty.channel.ChannelOperations.terminate(ChannelOperations.java:452)
    at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:684)
    at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:94)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
    at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
    at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296)
    at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
    at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1534)
    at io.netty.handler.ssl.SslHandler.decodeNonJdkCompatible(SslHandler.java:1295)
    at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1332)
    at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:508)
    at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:447)
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
    at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
    at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
    at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719)
    at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655)
    at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581)
    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
    at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
    at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    at java.lang.Thread.run(Thread.java:748)

Workes fine for files smaller than 200 Mb. Worked fine before updating all plugins to latest versions on Wednesday, May 5th 2021.

timja commented 3 years ago

Thanks for the report, will get that fixed

timja commented 3 years ago

This works on my machine, it appears to be not a bug in this plugin but a packaging issue from another plugin likely using an old jackson version, see https://stackoverflow.com/questions/49106108/xmlstreamwriter2-closecompletelyv-nosuchmethoderror

can you try un-install azure-commons as a start (it's no longer required)?

FP-Dmytro-B commented 3 years ago

I have uninstalled azure-commons and restarted Jenkins. The issue still happens.

timja commented 3 years ago

😢 if you're able to search for 'org.codehaus.stax2.XMLStreamWriter2' in your plugins by searching the jar files that would probably track it down, otherwise I'll check it out later

FP-Dmytro-B commented 3 years ago

I have run the following command on my Plugins folder and got the following results:

c:\Program Files (x86)\Jenkins\plugins>forfiles /S /M *.jar /C "cmd /c jar -tvf @file | findstr /C:"XMLStreamWriter2" && echo @path"

  1077 Thu May 14 14:15:20 EEST 2020 org/codehaus/stax2/XMLStreamWriter2.class
"c:\Program Files (x86)\Jenkins\plugins\azure-ad\WEB-INF\lib\stax2-api-4.2.1.jar"
  1077 Thu May 14 14:15:20 EEST 2020 org/codehaus/stax2/XMLStreamWriter2.class
"c:\Program Files (x86)\Jenkins\plugins\azure-sdk\WEB-INF\lib\stax2-api-4.2.1.jar"
timja commented 3 years ago

hmm must be something else, those look fine =/

silverl commented 3 years ago

Chiming in, hit the same issue today. Here's the exception trace. Note: The error says "downloading" but we were uploading to Azure storage.

ERROR: AzureStorage - Error occurred while downloading from Azure - buildserviceapi:Failed uploading file
com.microsoftopentechnologies.windowsazurestorage.exceptions.WAStorageException: Failed uploading file
    at com.microsoftopentechnologies.windowsazurestorage.service.UploadService.uploadCloudFile(UploadService.java:571)
    at com.microsoftopentechnologies.windowsazurestorage.service.UploadService$FileUploadThread.run(UploadService.java:119)
    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    at java.util.concurrent.FutureTask.run(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
    at java.lang.Thread.run(Unknown Source)
Caused by: com.azure.storage.file.share.models.ShareStorageException: Status code 413, "?<?xml version="1.0" encoding="utf-8"?><Error><Code>RequestBodyTooLarge</Code><Message>The request body is too large and exceeds the maximum permissible limit.
RequestId:0ebdcc36-801a-00e5-074d-479aa7000000
Time:2021-05-12T16:39:23.6599746Z</Message><MaxLimit>4194304</MaxLimit></Error>"
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
    at java.lang.reflect.Constructor.newInstance(Unknown Source)
    at com.azure.core.http.rest.RestProxy.instantiateUnexpectedException(RestProxy.java:337)
    at com.azure.core.http.rest.RestProxy.lambda$ensureExpectedStatus$5(RestProxy.java:376)
    at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:125)
    at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1815)
    at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.signalCached(MonoCacheTime.java:328)
    at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.onNext(MonoCacheTime.java:345)
    at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2397)
    at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.onSubscribe(MonoCacheTime.java:284)
    at reactor.core.publisher.FluxFlatMap.trySubscribeScalarMap(FluxFlatMap.java:191)
    at reactor.core.publisher.MonoFlatMap.subscribeOrReturn(MonoFlatMap.java:53)
    at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:57)
    at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52)
    at reactor.core.publisher.MonoCacheTime.subscribeOrReturn(MonoCacheTime.java:134)
    at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:57)
    at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:157)
    at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:130)
    at reactor.core.publisher.FluxHandle$HandleSubscriber.onNext(FluxHandle.java:118)
    at reactor.core.publisher.FluxMap$MapConditionalSubscriber.onNext(FluxMap.java:220)
    at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:130)
    at reactor.core.publisher.FluxHandleFuseable$HandleFuseableSubscriber.onNext(FluxHandleFuseable.java:184)
    at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107)
    at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1815)
    at reactor.core.publisher.MonoCollectList$MonoCollectListSubscriber.onComplete(MonoCollectList.java:128)
    at reactor.core.publisher.FluxPeek$PeekSubscriber.onComplete(FluxPeek.java:259)
    at reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:142)
    at reactor.netty.channel.FluxReceive.onInboundComplete(FluxReceive.java:389)
    at reactor.netty.channel.ChannelOperations.onInboundComplete(ChannelOperations.java:396)
    at reactor.netty.channel.ChannelOperations.terminate(ChannelOperations.java:452)
    at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:684)
    at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:94)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
    at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
    at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296)
    at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
    at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1534)
    at io.netty.handler.ssl.SslHandler.decodeNonJdkCompatible(SslHandler.java:1295)
    at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1332)
    at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:508)
    at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:447)
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
    at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
    at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
    at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
    at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719)
    at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655)
    at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581)
    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
    at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
    at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    ... 1 more
    Suppressed: java.lang.Exception: #block terminated with an error
        at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:99)
        at reactor.core.publisher.Mono.block(Mono.java:1703)
        at com.azure.storage.common.implementation.StorageImplUtils.blockWithOptionalTimeout(StorageImplUtils.java:128)
        at com.azure.storage.file.share.ShareFileClient.uploadWithResponse(ShareFileClient.java:973)
        at com.azure.storage.file.share.ShareFileClient.uploadWithResponse(ShareFileClient.java:942)
        at com.microsoftopentechnologies.windowsazurestorage.service.UploadService.uploadCloudFile(UploadService.java:562)
        at com.microsoftopentechnologies.windowsazurestorage.service.UploadService$FileUploadThread.run(UploadService.java:119)
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        ... 1 more
timja commented 3 years ago

@silverl that issue looks different to this even if it affects the same area, can you create a new issue so we don't mix the two issues.

In the new issue can you add more detail about the file? I tested with a ~250mb file and it uploaded just fine.

Full steps to reproduce will really help

silverl commented 3 years ago

@timja Done: https://github.com/jenkinsci/azure-storage-plugin/issues/189

timja commented 3 years ago

@FP-Dmytro-B I ran it with the same plugins and versions as you and didn't get an error 😢

FP-Dmytro-B commented 3 years ago

Was the file larger than 200Mb? The size definitely matters.

My files are .zip archives so I have hotfixed my job by adding archive split to 200Mb volumes. The upload works fine with such files.

Also, I have created a temp job that generates a dummy file of specified size with:

del BigDummyFile.foo /F /Q
fsutil file createnew BigDummyFile.foo 304857600

and than uploads it to Azure storage with default settings, and it works fine with size of 204857600 but fails with 304857600.

I can try to pinpoint more precise size that causes fail, if needed, but it's definitely something size-related.

timja commented 3 years ago

Yes it was a ~250mb file, it took ages to upload but got there in the end.

This isn't to do with the size the cause really, it's to do with class conflicts and the specific class that's conflicting is only invoked when the size is over 100mb I would guess.

Somehow you've got a conflicting class that's missing the right method

timja commented 3 years ago

I'm using this pipeline to try reproduce, does it work for you:

node {
    deleteDir()
    sh '''
        echo -e "hello\nworld" > file.txt
        for i in {1..24}; do cat file.txt file.txt > file2.txt && mv file2.txt file.txt; done
        du -sh file.txt # 240mb
    '''
    azureUpload containerName: 'jenkins', filesPath: 'file.txt', storageCredentialId: 'storage', storageType: 'blobstorage'
}
FP-Dmytro-B commented 3 years ago

It fails with java.io.IOException: Cannot run program "nohup" It seems you cant run sh step on Windows: https://stackoverflow.com/questions/45140614/jenkins-pipeline-sh-fail-with-cannot-run-program-nohup-on-windows

tr00st commented 3 years ago

Also encountering this with the same NoSuchMethodError on Win10 (plugin version 357.v36c07129d7d3).

java.lang.NoSuchMethodError: 'void org.codehaus.stax2.XMLStreamWriter2.closeCompletely()'

Thankfully downgrading back to 1.1.7's enabled me to run what I needed, at least. I'll be migrating to a separate box over the next few days, so might be able to leave this box in a state where it can break reliably. Not sure if you've managed to duplicate this your end yet, but would a windows-compatible pipeline script to reproduce it be of any use?

timja commented 3 years ago

I can't see how Windows could be the cause of this, unless there's a windows specific plugin that you're both using which is causing this conflict.

@tr00st could you provide a full plugin list using https://www.jenkins.io/doc/book/system-administration/diagnosing-errors/#how-to-report-a-bug please?

and no I have not managed to reproduce this

tr00st commented 3 years ago

Sure - plugin list is below. I'll try and spend some time stripping out plugins once our new build box is up and running, and see if I can narrow down any conflicts this end.

(Edit: realised that this is after I've restored 1.1.7 - will upgrade back to latest to ensure there's nothing else that would differ once I can get some quiet-time)

Jenkins: 2.277.4
OS: Windows 10 - 10.0
---
ace-editor:1.1
analysis-model-api:10.2.5
antisamy-markup-formatter:2.1
apache-httpcomponents-client-4-api:4.5.13-1.0
authentication-tokens:1.4
azure-commons:1.1.3
azure-sdk:12.vc102aedd3c66
blueocean-commons:1.24.6
blueocean-rest:1.24.6
bootstrap4-api:4.6.0-3
bouncycastle-api:2.20
branch-api:2.6.4
build-timeout:1.20
caffeine-api:2.9.1-23.v51c4e2c879c8
checks-api:1.7.0
cloudbees-folder:6.15
command-launcher:1.6
copyartifact:1.46
credentials-binding:1.24
credentials:2.4.1
data-tables-api:1.10.23-3
display-url-api:2.3.4
docker-commons:1.17
docker-workflow:1.26
dtkit-api:3.0.0
durable-task:1.36
echarts-api:5.1.0-2
external-monitor-job:1.7
favorite:2.3.3
font-awesome-api:5.15.3-2
forensics-api:1.0.0
git-client:3.7.1
git-server:1.9
git:4.7.1
github-api:1.123
github-branch-source:2.10.4
github:1.33.1
handlebars:3.0.8
htmlpublisher:1.25
icon-shim:3.0.0
jackson2-api:2.12.3
jaxb:2.3.0.1
jdk-tool:1.5
jjwt-api:0.11.2-9.c8b45b8bb173
jobConfigHistory:2.27
jquery-detached:1.2.1
jquery3-api:3.6.0-1
jsch:0.1.55.2
junit:1.49
ldap:2.7
lockable-resources:2.10
mailer:1.34
mask-passwords:3.0
matrix-auth:2.6.7
matrix-project:1.18
mercurial:2.15
metrics:4.0.2.7
momentjs:1.1.1
msbuild:1.30
octopusdeploy:3.1.3
okhttp-api:3.14.9
pam-auth:1.6
pipeline-build-step:2.13
pipeline-graph-analysis:1.10
pipeline-input-step:2.12
pipeline-milestone-step:1.3.2
pipeline-model-api:1.8.4
pipeline-model-declarative-agent:1.1.1
pipeline-model-definition:1.8.4
pipeline-model-extensions:1.8.4
pipeline-rest-api:2.19
pipeline-stage-step:2.5
pipeline-stage-tags-metadata:1.8.4
pipeline-stage-view:2.19
plain-credentials:1.7
plugin-util-api:2.2.0
popper-api:1.16.1-2
powershell:1.5
pubsub-light:1.14
resource-disposer:0.15
scm-api:2.6.4
script-security:1.77
snakeyaml-api:1.27.0
sse-gateway:1.24
ssh-credentials:1.18.1
structs:1.23
timestamper:1.13
token-macro:2.15
trilead-api:1.0.13
vagrant:1.0.2
variant:1.4
versionnumber:1.9
warnings-ng:9.1.0
windows-azure-storage:1.1.7
windows-slaves:1.8
workflow-aggregator:2.6
workflow-api:2.42
workflow-basic-steps:2.23
workflow-cps-global-lib:2.19
workflow-cps:2.92
workflow-durable-task-step:2.39
workflow-job:2.40
workflow-multibranch:2.24
workflow-scm-step:2.12
workflow-step-api:2.23
workflow-support:3.8
ws-cleanup:0.39
xunit:3.0.2

(Edit: 2021-06-09 - still absolutely planning on doing the above - work/life have put some blockers in the way, as usual)

timja commented 3 years ago

Looks related to https://github.com/jenkinsci/azure-ad-plugin/issues/121#issuecomment-867919247

Could you please add the JAVA_OPT -verbose:class and restart your Jenkins?

Trigger the issue, and when it fails can you copy out any class loading related logs, especially around jackson.

Example log:

[Loaded javax.xml.stream.XMLStreamException from /usr/lib/jvm/adoptopenjdk-8-hotspot/jre/lib/rt.jar]
[Loaded com.fasterxml.jackson.core.JsonGenerationException from file:/lib/jenkins-plugin-manager.jar]
[Loaded com.fasterxml.jackson.dataformat.xml.XmlFactoryBuilder from file:/var/jenkins_home/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.3.jar]
[Loaded com.fasterxml.jackson.core.FormatFeature from file:/lib/jenkins-plugin-manager.jar]
[Loaded com.fasterxml.jackson.dataformat.xml.deser.FromXmlParser$Feature from file:/var/jenkins_home/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.3.jar]
[Loaded com.fasterxml.jackson.dataformat.xml.ser.ToXmlGenerator$Feature from file:/var/jenkins_home/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.3.jar]
FP-Dmytro-B commented 3 years ago

I have added -verbose:class to the <arguments> section of Jenkins.xml file and restarted Jenkins service. Unfortunately, it failed to start. :(

In the Windows logs I only see: Starting C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\bin\java -Xrs -Xmx1024m -Dhudson.lifecycle=hudson.lifecycle.WindowsServiceLifecycle -jar "C:\Program Files (x86)\Jenkins\jenkins.war" --httpPort=8080 --webroot="C:\Program Files (x86)\Jenkins\war -verbose:class" followed by Child process [8224 - C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\bin\java -Xrs -Xmx1024m -Dhudson.lifecycle=hudson.lifecycle.WindowsServiceLifecycle -jar "C:\Program Files (x86)\Jenkins\jenkins.war" --httpPort=8080 --webroot="C:\Program Files (x86)\Jenkins\war"] terminated with -1

timja commented 3 years ago

-verbose:class needs to be after java and before the -jar

FP-Dmytro-B commented 3 years ago

-verbose:class needs to be after java and before the -jar

Thanks, that worked! The following lines appeared in jenkins.out.log file upon triggering a job with large file upload:

[Loaded java.lang.invoke.LambdaForm$BMH/325502054 from java.lang.invoke.LambdaForm]
[Loaded java.lang.invoke.LambdaForm$BMH/1148776788 from java.lang.invoke.LambdaForm]
[Loaded java.lang.invoke.LambdaForm$BMH/495388159 from java.lang.invoke.LambdaForm]
[Loaded java.lang.invoke.LambdaForm$BMH/1689815981 from java.lang.invoke.LambdaForm]
[Loaded java.lang.invoke.LambdaForm$BMH/345851101 from java.lang.invoke.LambdaForm]
[Loaded org.eclipse.jetty.server.session.Session$2 from file:/C:/windows/TEMP/winstone7053273478628742536.jar]
[Loaded org.eclipse.jetty.server.session.SessionHandler$2 from file:/C:/windows/TEMP/winstone7053273478628742536.jar]
[Loaded org.jenkinsci.plugins.workflow.job.views.FlowGraphAction$1 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/workflow-job/WEB-INF/lib/workflow-job.jar]
[Loaded hudson.model.ResourceController$1$1 from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/jenkins-core-2.289.1.jar]
[Loaded sun.reflect.GeneratedMethodAccessor625 from __JVM_DefineClass__]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.parser.ModelParser$_parseTriggers_closure27 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-definition/WEB-INF/lib/pipeline-model-definition.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.parser.ModelParser$_parseInternalFunctionCall_closure30 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-definition/WEB-INF/lib/pipeline-model-definition.jar]
[Loaded sun.reflect.GeneratedConstructorAccessor236 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedConstructorAccessor237 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedMethodAccessor626 from __JVM_DefineClass__]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.parser.ModelParser$_parseStep_closure32 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-definition/WEB-INF/lib/pipeline-model-definition.jar]
[Loaded sun.reflect.GeneratedConstructorAccessor238 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedMethodAccessor627 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedConstructorAccessor239 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedMethodAccessor628 from __JVM_DefineClass__]
[Loaded org.codehaus.groovy.runtime.powerassert.ValueRecorder from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/groovy-all-2.4.12.jar]
[Loaded org.codehaus.groovy.runtime.powerassert.Value from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/groovy-all-2.4.12.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.validator.DeclarativeValidatorContributor$validateElementAll$17 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-extensions/WEB-INF/lib/pipeline-model-extensions.jar]
[Loaded sun.reflect.GeneratedMethodAccessor629 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedMethodAccessor630 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedMethodAccessor631 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedMethodAccessor632 from __JVM_DefineClass__]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.validator.DeclarativeValidatorContributor$validateElementAll$18 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-extensions/WEB-INF/lib/pipeline-model-extensions.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.validator.ModelValidatorImpl$_validateElement_closure25 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-definition/WEB-INF/lib/pipeline-model-definition.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.validator.ModelValidatorImpl$_validateElement_closure26 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-definition/WEB-INF/lib/pipeline-model-definition.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.validator.ModelValidatorImpl$_validateElement_closure27 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-definition/WEB-INF/lib/pipeline-model-definition.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.validator.DeclarativeValidatorContributor$validateElementAll$19 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-extensions/WEB-INF/lib/pipeline-model-extensions.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.model.Triggers$typeForKey from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-definition/WEB-INF/lib/pipeline-model-definition.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.validator.ModelValidatorImpl$_validateElement_closure23 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-definition/WEB-INF/lib/pipeline-model-definition.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.validator.DeclarativeValidatorContributor$validateElementAll$20 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-extensions/WEB-INF/lib/pipeline-model-extensions.jar]
[Loaded WorkflowScript from file:/groovy/shell]
[Loaded sun.reflect.GeneratedConstructorAccessor240 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedConstructorAccessor241 from __JVM_DefineClass__]
[Loaded org.jenkinsci.plugins.workflow.job.views.FlowGraphTableAction$1 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/workflow-job/WEB-INF/lib/workflow-job.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter from file:/groovy/script]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter$_createWithCredentialsParameters_closure1 from file:/groovy/script]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter$WhenEvaluator from file:/groovy/script]
[Loaded sun.reflect.GeneratedMethodAccessor633 from __JVM_DefineClass__]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.agent.CheckoutScript from file:/groovy/script]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.agent.impl.AnyScript from file:/groovy/script]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.agent.impl.LabelScript from file:/groovy/script]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor551 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor552 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor553 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor554 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor555 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor556 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor557 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor558 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor559 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor560 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor561 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor562 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor563 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor564 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor565 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor566 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor567 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor568 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor569 from __JVM_DefineClass__]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.agent.CheckoutScript$doCheckout from file:/groovy/script]
[Loaded org.jenkinsci.plugins.gitclient.CliGitAPIImpl$2 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/git-client/WEB-INF/lib/git-client.jar]
[Loaded org.jenkinsci.plugins.gitclient.CliGitAPIImpl$5 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/git-client/WEB-INF/lib/git-client.jar]
[Loaded org.eclipse.jgit.internal.storage.file.WindowCache$SoftRef from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/git-client/WEB-INF/lib/org.eclipse.jgit-5.11.1.202105131744-r.jar]
[Loaded org.eclipse.jgit.internal.storage.file.WindowCache$StatsRecorderImpl$$Lambda$714/659751423 from org.eclipse.jgit.internal.storage.file.WindowCache$StatsRecorderImpl]
[Loaded org.eclipse.jgit.internal.storage.file.WindowCache$Entry from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/git-client/WEB-INF/lib/org.eclipse.jgit-5.11.1.202105131744-r.jar]
[Loaded org.eclipse.jgit.util.Monitoring from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/git-client/WEB-INF/lib/org.eclipse.jgit-5.11.1.202105131744-r.jar]
[Loaded javax.management.JMException from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded javax.management.OperationsException from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded javax.management.MalformedObjectNameException from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded javax.management.InstanceAlreadyExistsException from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded javax.management.MBeanException from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded javax.management.MBeanRegistrationException from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded javax.management.NotCompliantMBeanException from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded javax.management.InstanceNotFoundException from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded org.eclipse.jgit.internal.storage.file.WindowCache$StatsRecorderImpl$$Lambda$715/220870426 from org.eclipse.jgit.internal.storage.file.WindowCache$StatsRecorderImpl]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.model.CredentialsBindingHandler$forId from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-extensions/WEB-INF/lib/pipeline-model-extensions.jar]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.model.CredentialsBindingHandler$EnvVarResolver from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-extensions/WEB-INF/lib/pipeline-model-extensions.jar]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor570 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor571 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor572 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor573 from __JVM_DefineClass__]
[Loaded org.jenkinsci.plugins.plaincredentials.StringCredentials$NameProvider from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/plain-credentials/WEB-INF/lib/plain-credentials.jar]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor574 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor575 from __JVM_DefineClass__]
[Loaded org.jenkinsci.plugins.workflow.cps.DSL$$Lambda$716/1146586849 from org.jenkinsci.plugins.workflow.cps.DSL]
[Loaded org.jenkinsci.plugins.workflow.cps.DSL$$Lambda$717/383496424 from org.jenkinsci.plugins.workflow.cps.DSL]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor576 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor577 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor578 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor579 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedConstructorAccessor242 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor580 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor581 from __JVM_DefineClass__]
[Loaded org.jenkinsci.plugins.durabletask.PowershellScript$1 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/durable-task/WEB-INF/lib/durable-task.jar]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor582 from __JVM_DefineClass__]
[Loaded org.jenkinsci.plugins.pipeline.modeldefinition.SyntheticStageNames$postBuild$0 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/pipeline-model-api/WEB-INF/lib/pipeline-model-api.jar]
[Loaded hudson.plugins.ws_cleanup.RemoteCleaner from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/ws-cleanup/WEB-INF/lib/ws-cleanup.jar]
[Loaded hudson.plugins.ws_cleanup.Wipeout from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/ws-cleanup/WEB-INF/lib/ws-cleanup.jar]
[Loaded hudson.plugins.ws_cleanup.Cleanup from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/ws-cleanup/WEB-INF/lib/ws-cleanup.jar]
[Loaded hudson.plugins.ws_cleanup.Wipeout$DisposableImpl from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/ws-cleanup/WEB-INF/lib/ws-cleanup.jar]
[Loaded org.jenkinsci.plugins.resourcedisposer.AsyncResourceDisposer$WorkItem from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/resource-disposer/WEB-INF/lib/resource-disposer.jar]
[Loaded org.jenkinsci.plugins.resourcedisposer.Disposable$State from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/resource-disposer/WEB-INF/lib/resource-disposer.jar]
[Loaded org.jenkinsci.plugins.resourcedisposer.Disposable$State$Thrown from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/resource-disposer/WEB-INF/lib/resource-disposer.jar]
[Loaded org.jenkinsci.plugins.resourcedisposer.Disposable$State$ToDispose from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/resource-disposer/WEB-INF/lib/resource-disposer.jar]
[Loaded org.jenkinsci.plugins.resourcedisposer.Disposable$State$Purged from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/resource-disposer/WEB-INF/lib/resource-disposer.jar]
[Loaded sun.reflect.GeneratedSerializationConstructorAccessor583 from __JVM_DefineClass__]
[Loaded java.nio.file.attribute.DosFileAttributeView from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded sun.nio.fs.WindowsFileAttributeViews$Dos from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded jenkins.util.io.PathRemover$$Lambda$718/778220585 from jenkins.util.io.PathRemover]
[Loaded jenkins.util.io.PathRemover$$Lambda$719/614129497 from jenkins.util.io.PathRemover]
[Loaded sun.reflect.GeneratedConstructorAccessor243 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedMethodAccessor634 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedMethodAccessor635 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedConstructorAccessor244 from __JVM_DefineClass__]
[Loaded sun.reflect.GeneratedMethodAccessor636 from __JVM_DefineClass__]

As for the lines with Jackson , the search in jenkins.out.log returns this:

    Line 19378: [Loaded com.fasterxml.jackson.databind.deser.std.DateDeserializers$CalendarDeserializer from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19379: [Loaded com.fasterxml.jackson.databind.deser.std.DateDeserializers$DateDeserializer from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19379: [Loaded com.fasterxml.jackson.databind.deser.std.DateDeserializers$DateDeserializer from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19379: [Loaded com.fasterxml.jackson.databind.deser.std.DateDeserializers$DateDeserializer from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19380: [Loaded com.fasterxml.jackson.databind.deser.std.FactoryBasedEnumDeserializer from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19380: [Loaded com.fasterxml.jackson.databind.deser.std.FactoryBasedEnumDeserializer from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19380: [Loaded com.fasterxml.jackson.databind.deser.std.FactoryBasedEnumDeserializer from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19381: [Loaded com.fasterxml.jackson.databind.deser.BeanDeserializer$1 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19381: [Loaded com.fasterxml.jackson.databind.deser.BeanDeserializer$1 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19381: [Loaded com.fasterxml.jackson.databind.deser.BeanDeserializer$1 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19382: [Loaded com.fasterxml.jackson.databind.cfg.CoercionConfigs$1 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19382: [Loaded com.fasterxml.jackson.databind.cfg.CoercionConfigs$1 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19382: [Loaded com.fasterxml.jackson.databind.cfg.CoercionConfigs$1 from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19383: [Loaded com.azure.core.util.serializer.JacksonAdapter$HeaderCollectionHandler from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/azure-core-1.16.0.jar]
    Line 19385: [Loaded com.azure.core.util.serializer.JacksonAdapter$$Lambda$574/782915933 from com.azure.core.util.serializer.JacksonAdapter]
    Line 19385: [Loaded com.azure.core.util.serializer.JacksonAdapter$$Lambda$574/782915933 from com.azure.core.util.serializer.JacksonAdapter]
    Line 19695: [Loaded com.fasterxml.jackson.dataformat.xml.annotation.JacksonXmlProperty from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19695: [Loaded com.fasterxml.jackson.dataformat.xml.annotation.JacksonXmlProperty from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19695: [Loaded com.fasterxml.jackson.dataformat.xml.annotation.JacksonXmlProperty from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19696: [Loaded com.fasterxml.jackson.dataformat.xml.util.TypeUtil from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19696: [Loaded com.fasterxml.jackson.dataformat.xml.util.TypeUtil from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19697: [Loaded com.fasterxml.jackson.databind.JsonSerializer$None from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19697: [Loaded com.fasterxml.jackson.databind.JsonSerializer$None from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19697: [Loaded com.fasterxml.jackson.databind.JsonSerializer$None from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-databind-2.12.3.jar]
    Line 19698: [Loaded com.fasterxml.jackson.dataformat.xml.util.AnnotationUtil from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19698: [Loaded com.fasterxml.jackson.dataformat.xml.util.AnnotationUtil from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19699: [Loaded com.fasterxml.jackson.module.jaxb.JaxbAnnotationIntrospector from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-module-jaxb-annotations-2.12.3.jar]
    Line 19699: [Loaded com.fasterxml.jackson.module.jaxb.JaxbAnnotationIntrospector from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-module-jaxb-annotations-2.12.3.jar]
    Line 19699: [Loaded com.fasterxml.jackson.module.jaxb.JaxbAnnotationIntrospector from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-module-jaxb-annotations-2.12.3.jar]
    Line 19700: [Loaded com.fasterxml.jackson.dataformat.xml.annotation.JacksonXmlCData from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19700: [Loaded com.fasterxml.jackson.dataformat.xml.annotation.JacksonXmlCData from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19700: [Loaded com.fasterxml.jackson.dataformat.xml.annotation.JacksonXmlCData from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19701: [Loaded com.fasterxml.jackson.dataformat.xml.util.XmlInfo from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19701: [Loaded com.fasterxml.jackson.dataformat.xml.util.XmlInfo from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19702: [Loaded com.fasterxml.jackson.dataformat.xml.ser.UnwrappingXmlBeanSerializer from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 19702: [Loaded com.fasterxml.jackson.dataformat.xml.ser.UnwrappingXmlBeanSerializer from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/azure-sdk/WEB-INF/lib/jackson-dataformat-xml-2.12.2.jar]
    Line 22398: [Loaded com.fasterxml.jackson.core.json.DupDetector from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-core-2.12.3.jar]
    Line 22398: [Loaded com.fasterxml.jackson.core.json.DupDetector from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-core-2.12.3.jar]
    Line 22398: [Loaded com.fasterxml.jackson.core.json.DupDetector from file:/C:/Program%20Files%20(x86)/Jenkins/plugins/jackson2-api/WEB-INF/lib/jackson-core-2.12.3.jar]
timja commented 3 years ago

Is there any reference to org.codehaus.stax2.XMLStreamWriter2? I can't see it in what you've pasted here

You could also try this on 2.298 or 2.299, stax was removed from the Jenkins war, which caused https://github.com/jenkinsci/azure-storage-plugin/issues/194 but may affect this.

FP-Dmytro-B commented 3 years ago

Yes, there is one reference to this class, however it happens before the job start. Here is this log section (arrow added by me):

[Loaded javax.xml.stream.XMLOutputFactory from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded com.ctc.wstx.cfg.OutputConfigFlags from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded org.codehaus.stax2.XMLOutputFactory2 from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded com.ctc.wstx.stax.WstxOutputFactory from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded javax.xml.stream.XMLStreamWriter from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded javax.xml.stream.util.XMLEventConsumer from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded javax.xml.stream.XMLEventWriter from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
--->[Loaded org.codehaus.stax2.XMLStreamWriter2 from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded org.codehaus.stax2.io.Stax2Result from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded javax.xml.transform.stream.StreamResult from C:\Program Files\OpenJDK\openjdk-8u275-b01\jre\lib\rt.jar]
[Loaded com.ctc.wstx.io.UTF8Writer from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded com.ctc.wstx.sw.XmlWriter from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded com.ctc.wstx.sw.BufferingXmlWriter from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded com.ctc.wstx.sw.EncodingXmlWriter from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded com.ctc.wstx.sw.ISOLatin1XmlWriter from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded com.ctc.wstx.sw.AsciiXmlWriter from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
[Loaded org.codehaus.stax2.validation.ValidationContext from file:/C:/Program%20Files%20(x86)/Jenkins/war/WEB-INF/lib/wstx-asl-3.2.9.jar]
timja commented 3 years ago

This may be fixed in jackson 2.12.4 due for release in a month.

If I could reproduce this I would verify 😢

If anyone who can reproduce this wants to they would need to:

elkh510 commented 3 years ago

hi @timja I have updated to Jackson 2.12.4 and have the same issue

Error was received while reading the incoming data. The connection will be closed.
java.lang.NoSuchMethodError: 'void org.codehaus.stax2.XMLStreamWriter2.closeCompletely()'

Jenkins: 2.289.2-lts-jdk11 Plugins:

Pipeline: Basic Steps (workflow-basic-steps): 2.23
JQuery3 API Plugin (jquery3-api): 3.6.0-2
SSH server (sshd): 3.1.0
Locale plugin (locale): 1.4
REST API for Blue Ocean (blueocean-rest): 1.24.7
xUnit plugin (xunit): 3.0.2
Pipeline: Shared Groovy Libraries (workflow-cps-global-lib): 2.21
Docker Commons Plugin (docker-commons): 1.17
Azure SDK API Plugin (azure-sdk): 25.vcde945b30f00
Credentials Plugin (credentials): 2.5
Durable Task Plugin (durable-task): 1.38
Forensics API Plugin (forensics-api): 1.2.1
Authorize Project (authorize-project): 1.4.0
Bitbucket Branch Source Plugin (cloudbees-bitbucket-branch-source): 2.9.9
Job and Stage monitoring Plugin (github-autostatus): 3.6.2
Generic Webhook Trigger Plugin (generic-webhook-trigger): 1.74
Oracle Java SE Development Kit Installer Plugin (jdk-tool): 1.5
Parameterized Scheduler (parameterized-scheduler): 1.0
Pipeline (workflow-aggregator): 2.6
JavaScript GUI Lib: Handlebars bundle plugin (handlebars): 3.0.8
JUnit Plugin (junit): 1.51
ECharts API Plugin (echarts-api): 5.1.2-3
Web for Blue Ocean (blueocean-web): 1.24.7
HTTP Request Plugin (http_request): 1.9.0
Pipeline: Nodes and Processes (workflow-durable-task-step): 2.39
Branch API Plugin (branch-api): 2.6.5
jQuery plugin (jquery): 1.12.4-1
Allure for Jenkins (allure-jenkins): 3.26.1
GitHub Branch Source Plugin (github-branch-source): 2.11.1
Run Condition Plugin (run-condition): 1.5
DataTables.net API Plugin (data-tables-api): 1.10.25-2
DTKit 2 API. (dtkit-api): 3.0.0
build user vars plugin (build-user-vars-plugin): 1.7
Font Awesome API Plugin (font-awesome-api): 5.15.3-4
Build Monitor View (build-monitor-plugin): 1.12+build.201809061734
JavaScript GUI Lib: ACE Editor bundle plugin (ace-editor): 1.1
MultiBranch Action Triggers Plugin (multibranch-action-triggers): 1.8.6
Blue Ocean (blueocean): 1.24.7
JavaScript GUI Lib: jQuery bundles (jQuery and jQuery UI) plugin (jquery-detached): 1.2.1
Pipeline: Declarative (pipeline-model-definition): 1.8.5
Favorite (favorite): 2.3.3
Cobertura Plugin (cobertura): 1.16
Pipeline: Stage Step (pipeline-stage-step): 2.5
Git client plugin (git-client): 3.8.0
SAML Plugin (saml): 2.0.7
Logstash (logstash): 2.4.0
AnsiColor (ansicolor): 1.0.0
CloudBees Disk Usage Simple Plugin (cloudbees-disk-usage-simple): 0.10
Popper.js API Plugin (popper-api): 1.16.1-2
Lockable Resources plugin (lockable-resources): 2.11
Server Sent Events (SSE) Gateway Plugin (sse-gateway): 1.24
Icon Shim (icon-shim): 3.0.0
Pipeline Utility Steps (pipeline-utility-steps): 2.8.0
Azure Storage plugin (windows-azure-storage): 358.v5c001416d74f
Structs Plugin (structs): 1.23
WMI Windows Agents Plugin (windows-slaves): 1.8
Pipeline: Groovy (workflow-cps): 2.93
Docker Pipeline (docker-workflow): 1.26
Green Balls (greenballs): 1.15.1
Maven Integration plugin (maven-plugin): 3.12
Popper.js 2 API Plugin (popper2-api): 2.5.4-3
Command Agent Launcher Plugin (command-launcher): 1.6
Pipeline SCM API for Blue Ocean (blueocean-pipeline-scm-api): 1.24.7
JavaScript GUI Lib: Moment.js bundle plugin (momentjs): 1.1.1
Pipeline implementation for Blue Ocean (blueocean-pipeline-api-impl): 1.24.7
Extended Read Permission Plugin (extended-read-permission): 3.2
Pipeline: Multibranch build strategy extension (multibranch-build-strategy-extension): 1.0.10
Bootstrap 4 API Plugin (bootstrap4-api): 4.6.0-3
Pipeline: Model API (pipeline-model-api): 1.8.5
Kubernetes Credentials Plugin (kubernetes-credentials): 0.9.0
Copy Artifact Plugin (copyartifact): 1.46.1
Extended Choice Parameter Plug-In (extended-choice-parameter): 0.82
Autofavorite for Blue Ocean (blueocean-autofavorite): 1.2.4
Timestamper (timestamper): 1.13
Snakeyaml API Plugin (snakeyaml-api): 1.29.1
LDAP Plugin (ldap): 2.7
Handy Uri Templates 2.x API Plugin (handy-uri-templates-2-api): 2.1.8-1.0
Bitbucket Pipeline for Blue Ocean (blueocean-bitbucket-pipeline): 1.24.7
Mercurial plugin (mercurial): 2.15
Pipeline: GitHub (pipeline-github): 2.7
Pipeline: Milestone Step (pipeline-milestone-step): 1.3.2
Pipeline: SCM Step (workflow-scm-step): 2.13
OkHttp Plugin (okhttp-api): 3.14.9
Folders Plugin (cloudbees-folder): 6.15
Config File Provider Plugin (config-file-provider): 3.8.1
Ant Plugin (ant): 1.11
Azure Credentials (azure-credentials): 182.v3ccd4a755864
Pipeline Graph Analysis Plugin (pipeline-graph-analysis): 1.11
Git Parameter Plug-In (git-parameter): 0.9.13
Events API for Blue Ocean (blueocean-events): 1.24.7
Display URL API (display-url-api): 2.3.5
Variant Plugin (variant): 1.4
SonarQube Scanner for Jenkins (sonar): 2.13.1
Checks API plugin (checks-api): 1.7.2
Ivy Plugin (ivy): 2.1
Pipeline: REST API Plugin (pipeline-rest-api): 2.19
Pub-Sub "light" Bus (pubsub-light): 1.16
Pipeline: Declarative Extension Points API (pipeline-model-extensions): 1.8.5
Mailer Plugin (mailer): 1.34
Pipeline: Stage Tags Metadata (pipeline-stage-tags-metadata): 1.8.5
Pipeline: Build Step (pipeline-build-step): 2.14
Kubernetes Client API Plugin (kubernetes-client-api): 5.4.1
Job DSL (job-dsl): 1.77
Matrix Project Plugin (matrix-project): 1.19
Design Language (jenkins-design-language): 1.24.7
Pipeline: API (workflow-api): 2.46
Authentication Tokens API Plugin (authentication-tokens): 1.4
Dashboard for Blue Ocean (blueocean-dashboard): 1.24.7
Git Changelog (git-changelog): 3.11
bouncycastle API Plugin (bouncycastle-api): 2.20
Kubernetes plugin (kubernetes): 1.30.1
GitHub plugin (github): 1.33.1
Basic Branch Build Strategies Plugin (basic-branch-build-strategies): 1.3.2
SCM API Plugin (scm-api): 2.6.4
Pipeline: Job (workflow-job): 2.41
Pipeline: Stage View Plugin (pipeline-stage-view): 2.19
JSch dependency plugin (jsch): 0.1.55.2
Personalization for Blue Ocean (blueocean-personalization): 1.24.7
Allure Jenkins Plugin (allure-jenkins-plugin): 2.29.0
Pipeline: Declarative Agent API (pipeline-model-declarative-agent): 1.1.1
Blue Ocean Core JS (blueocean-core-js): 1.24.7
PAM Authentication plugin (pam-auth): 1.6
Trilead API Plugin (trilead-api): 1.0.13
Jackson 2 API Plugin (jackson2-api): 2.12.4
GitHub Pipeline for Blue Ocean (blueocean-github-pipeline): 1.24.7
GitHub Authentication plugin (github-oauth): 0.33
Slack Notification Plugin (slack): 2.48
REST Implementation for Blue Ocean (blueocean-rest-impl): 1.24.7
Next Build Number Plugin (next-build-number): 1.6
JIRA Integration for Blue Ocean (blueocean-jira): 1.24.7
JaCoCo plugin (jacoco): 3.3.0
Artifactory Plugin (artifactory): 3.12.5
Autocomplete Parameter Plugin (autocomplete-parameter): 1.0
Script Security Plugin (script-security): 1.77
Caffeine API Plugin (caffeine-api): 2.9.1-23.v51c4e2c879c8
Config API for Blue Ocean (blueocean-config): 1.24.7
Pipeline: Step API (workflow-step-api): 2.24
Bootstrap 5 API Plugin (bootstrap5-api): 5.0.2-1
File Operations Plugin (file-operations): 1.11
i18n for Blue Ocean (blueocean-i18n): 1.24.7
Jira plugin (jira): 3.5
Metrics Plugin (metrics): 4.0.2.8
GitHub API Plugin (github-api): 1.123
External Monitor Job Type Plugin (external-monitor-job): 1.7
Plugin Utilities API Plugin (plugin-util-api): 2.4.0
HTML Publisher plugin (htmlpublisher): 1.25
Pipeline: Supporting APIs (workflow-support): 3.8
Java JSON Web Token (JJWT) Plugin (jjwt-api): 0.11.2-9.c8b45b8bb173
SSH Credentials Plugin (ssh-credentials): 1.19
Azure Artifact Manager plugin (azure-artifact-manager): 92.v5205e9195328
Apache HttpComponents Client 4.x API Plugin (apache-httpcomponents-client-4-api): 4.5.13-1.0
Credentials Binding Plugin (credentials-binding): 1.27
Token Macro Plugin (token-macro): 2.15
Common API for Blue Ocean (blueocean-commons): 1.24.7
Display URL for Blue Ocean (blueocean-display-url): 2.4.1
Git plugin (git): 4.7.2
Blue Ocean Pipeline Editor (blueocean-pipeline-editor): 1.24.7
GIT server Plugin (git-server): 1.10
Pipeline: Input Step (pipeline-input-step): 2.12
Google OAuth Credentials plugin (google-oauth-plugin): 1.0.6
Matrix Authorization Strategy Plugin (matrix-auth): 2.6.7
JAXB plugin (jaxb): 2.3.0.1
Azure AD Plugin (azure-ad): 175.v5513346d764a
OWASP Markup Formatter Plugin (antisamy-markup-formatter): 2.1
Javadoc Plugin (javadoc): 1.6
Git Pipeline for Blue Ocean (blueocean-git-pipeline): 1.24.7
Pipeline: Multibranch (workflow-multibranch): 2.26
Gradle Plugin (gradle): 1.37.1
Plain Credentials Plugin (plain-credentials): 1.7
GitHub Integration Plugin (github-pullrequest): 0.3.0
Synopsys Detect plugin (blackduck-detect): 3.1.0
OAuth Credentials plugin (oauth-credentials): 0.4
JWT for Blue Ocean (blueocean-jwt): 1.24.7
Code Coverage API Plugin (code-coverage-api): 1.4.0

Help please.

timja commented 3 years ago

Can you provide your plugins list with this script please: https://www.jenkins.io/participate/report-issue/#Howtoreportanissue-WhatinformationtoprovideforEnvironmentandDescription

timja commented 3 years ago

@elkh510 does this pipeline trigger the issue for you? https://github.com/jenkinsci/azure-storage-plugin/issues/188#issuecomment-840408711

I've never been able to reproduce this so it's hard for me to fix

elkh510 commented 3 years ago

@timja

Can you provide your plugins list with this script please:

Jenkins: 2.289.2
OS: Linux - 5.4.0-1049-azure
---
workflow-basic-steps:2.23
jquery3-api:3.6.0-2
sshd:3.1.0
locale:1.4
blueocean-rest:1.24.7
xunit:3.0.2
workflow-cps-global-lib:2.21
docker-commons:1.17
azure-sdk:25.vcde945b30f00
credentials:2.5
durable-task:1.38
forensics-api:1.2.1
authorize-project:1.4.0
cloudbees-bitbucket-branch-source:2.9.9
github-autostatus:3.6.2
generic-webhook-trigger:1.74
jdk-tool:1.5
parameterized-scheduler:1.0
workflow-aggregator:2.6
handlebars:3.0.8
junit:1.51
echarts-api:5.1.2-3
blueocean-web:1.24.7
http_request:1.9.0
workflow-durable-task-step:2.39
branch-api:2.6.5
jquery:1.12.4-1
allure-jenkins:3.26.1
github-branch-source:2.11.1
run-condition:1.5
data-tables-api:1.10.25-2
dtkit-api:3.0.0
build-user-vars-plugin:1.7
font-awesome-api:5.15.3-4
build-monitor-plugin:1.12+build.201809061734
ace-editor:1.1
multibranch-action-triggers:1.8.6
blueocean:1.24.7
jquery-detached:1.2.1
pipeline-model-definition:1.8.5
favorite:2.3.3
cobertura:1.16
pipeline-stage-step:2.5
git-client:3.8.0
saml:2.0.7
logstash:2.4.0
ansicolor:1.0.0
cloudbees-disk-usage-simple:0.10
popper-api:1.16.1-2
lockable-resources:2.11
sse-gateway:1.24
icon-shim:3.0.0
pipeline-utility-steps:2.8.0
windows-azure-storage:358.v5c001416d74f
structs:1.23
windows-slaves:1.8
workflow-cps:2.93
docker-workflow:1.26
greenballs:1.15.1
maven-plugin:3.12
popper2-api:2.5.4-3
command-launcher:1.6
blueocean-pipeline-scm-api:1.24.7
momentjs:1.1.1
blueocean-pipeline-api-impl:1.24.7
extended-read-permission:3.2
multibranch-build-strategy-extension:1.0.10
bootstrap4-api:4.6.0-3
pipeline-model-api:1.8.5
kubernetes-credentials:0.9.0
copyartifact:1.46.1
extended-choice-parameter:0.82
blueocean-autofavorite:1.2.4
timestamper:1.13
snakeyaml-api:1.29.1
ldap:2.7
handy-uri-templates-2-api:2.1.8-1.0
blueocean-bitbucket-pipeline:1.24.7
mercurial:2.15
pipeline-github:2.7
pipeline-milestone-step:1.3.2
workflow-scm-step:2.13
okhttp-api:3.14.9
cloudbees-folder:6.15
config-file-provider:3.8.1
ant:1.11
azure-credentials:182.v3ccd4a755864
pipeline-graph-analysis:1.11
git-parameter:0.9.13
blueocean-events:1.24.7
display-url-api:2.3.5
variant:1.4
sonar:2.13.1
checks-api:1.7.2
ivy:2.1
pipeline-rest-api:2.19
pubsub-light:1.16
pipeline-model-extensions:1.8.5
mailer:1.34
pipeline-stage-tags-metadata:1.8.5
pipeline-build-step:2.14
kubernetes-client-api:5.4.1
job-dsl:1.77
matrix-project:1.19
jenkins-design-language:1.24.7
workflow-api:2.46
authentication-tokens:1.4
blueocean-dashboard:1.24.7
git-changelog:3.11
bouncycastle-api:2.20
kubernetes:1.30.1
github:1.33.1
basic-branch-build-strategies:1.3.2
scm-api:2.6.4
workflow-job:2.41
pipeline-stage-view:2.19
jsch:0.1.55.2
blueocean-personalization:1.24.7
allure-jenkins-plugin:2.29.0
pipeline-model-declarative-agent:1.1.1
blueocean-core-js:1.24.7
pam-auth:1.6
trilead-api:1.0.13
jackson2-api:2.12.4
blueocean-github-pipeline:1.24.7
github-oauth:0.33
slack:2.48
blueocean-rest-impl:1.24.7
next-build-number:1.6
blueocean-jira:1.24.7
jacoco:3.3.0
artifactory:3.12.5
autocomplete-parameter:1.0
script-security:1.77
caffeine-api:2.9.1-23.v51c4e2c879c8
blueocean-config:1.24.7
workflow-step-api:2.24
bootstrap5-api:5.0.2-1
file-operations:1.11
blueocean-i18n:1.24.7
jira:3.5
metrics:4.0.2.8
github-api:1.123
external-monitor-job:1.7
plugin-util-api:2.4.0
htmlpublisher:1.25
workflow-support:3.8
jjwt-api:0.11.2-9.c8b45b8bb173
ssh-credentials:1.19
azure-artifact-manager:92.v5205e9195328
apache-httpcomponents-client-4-api:4.5.13-1.0
credentials-binding:1.27
token-macro:2.15
blueocean-commons:1.24.7
blueocean-display-url:2.4.1
git:4.7.2
blueocean-pipeline-editor:1.24.7
git-server:1.10
pipeline-input-step:2.12
google-oauth-plugin:1.0.6
matrix-auth:2.6.7
jaxb:2.3.0.1
azure-ad:175.v5513346d764a
antisamy-markup-formatter:2.1
javadoc:1.6
blueocean-git-pipeline:1.24.7
workflow-multibranch:2.26
gradle:1.37.1
plain-credentials:1.7
github-pullrequest:0.3.0
blackduck-detect:3.1.0
oauth-credentials:0.4
blueocean-jwt:1.24.7
code-coverage-api:1.4.0
elkh510 commented 3 years ago

@elkh510 does this pipeline trigger the issue for you?

188 (comment)

I've never been able to reproduce this so it's hard for me to fix

no, with this one

node('master') {
    deleteDir()
    script{
        String randomString = org.apache.commons.lang.RandomStringUtils.random(9, true, true)
        def j = "kk${randomString}k.txt"
    sh """
        dd if=/dev/urandom of=${j} bs=1MB count=768
        du -sh ${j} # 240mb
    """
    // script{

    // }
    // println(currentBuild.rawBuild.getCause(Cause.UserIdCause).getUserId())
    // println(env.llll)
    azureUpload containerName: 'jenkins-backup', filesPath: j, storageCredentialId: "bd26ed58-85cd-4a44-8c03-9231521db96d", storageType: 'blobstorage'
    }
}

and get this error in jenkins

2021-09-02 13:10:42.094+0000 [id=175]   WARNING i.n.c.AbstractChannelHandlerContext#invokeExceptionCaught: An exception 'java.lang.NoSuchMethodError: 'void org.codehaus.stax2.XMLStreamWriter2.closeCompletely()'' [enable DEBUG level for full stacktrace] was thrown by a user handler's exceptionCaught() method while handling the following exception:
java.lang.NoSuchMethodError: 'void org.codehaus.stax2.XMLStreamWriter2.closeCompletely()'
    at com.fasterxml.jackson.dataformat.xml.ser.ToXmlGenerator.close(ToXmlGenerator.java:1309)
    at com.fasterxml.jackson.databind.ObjectMapper._writeValueAndClose(ObjectMapper.java:4492)

it seems like Azure Storage continues to use Azure Commons instead of the Azure SDK API. or uses some old config files. or maybe the Azure SDK API is referring to Jackson 2 API version 2.12.3. how can this be verified? or maybe we will schedule a quick sync, then I can show where is the problem and provide access to Jenkins what do you think @timja ?

timja commented 3 years ago

your plugin list shows azure commons isn't in there I'll try reproduce with that pipeline thanks.

Is that jenkins installed on an Azure VM via debian package? If I can't reproduce locally I'll try on a VM

elkh510 commented 3 years ago

Is that jenkins installed on an Azure VM via debian package?

no with helm chart version 3.5.1 and image 'jenkins/jenkins:2.277.4-lts-jdk11' values bellow after install I restore backup(full copy of jenkins home dir) and update all plugins and then have this issue

persistence:
  enabled: true
  storageClass: default #standard
  size: 128Gi
  mounts:
    - mountPath: /var/jenkins_backup
      name: jenkins-backup
      readOnly: false
controller:
  tag: 2.277.4-lts-jdk11
  adminSecret: true
  adminUser: "adminUser"
  adminPassword: "adminPassword"
  sidecars:
    configAutoReload:
      enabled: true
  healthProbes: true
  probes:
    startupProbe:
      failureThreshold: 5
      periodSeconds: 10
      timeoutSeconds: 600
    livenessProbe:
      failureThreshold: 5
      periodSeconds: 10
      timeoutSeconds: 600
    readinessProbe:
      failureThreshold: 3
      periodSeconds: 10
      timeoutSeconds: 5
  numExecutors: 2
  enableXmlConfig: true
  runAsUser: 0
  javaOpts: >
    -Xms1g -Xmx3g -Djava.awt.headless=true
    -Dhudson.model.DirectoryBrowserSupport.CSP="" -XX:+PrintFlagsFinal -Xdebug
    -Xrunjdwp:transport=dt_socket,server=y,address=8000,suspend=n
    -Dcom.sun.management.jmxremote=true
    -Dcom.sun.management.jmxremote.port=3000
    -Dcom.sun.management.jmxremote.rmi.port=3001
    -Djava.rmi.server.hostname=127.0.0.1
    -Dcom.sun.management.jmxremote.local.only=false
    -Dcom.sun.management.jmxremote.authenticate=false
    -Dcom.sun.management.jmxremote.ssl=false
  extraPorts:
    - name: debug-port
      port: 8000
    - name: jmxremote-port
      port: 3000
    - name: jmx-rmi-port
      port: 3001
  prometheus:
    enabled: true
    serviceMonitorAdditionalLabels:
      release: prometheus
  resources:
    requests:
      cpu: '2'
      memory: 4Gi
    limits:
      cpu: '6'
      memory: 12Gi
  ingress:
    enabled: true
    annotations:
      kubernetes.io/ingress.class: nginx
      nginx.ingress.kubernetes.io/ssl-redirect: 'true'
      cert-manager.io/cluster-issuer: letsencrypt-prod
      nginx.ingress.kubernetes.io/proxy-body-size: 100m
    hostName: jenkins.hostName.com
    tls:
      - secretName: jenkins
    hosts:
      - jenkins.hostName.com
  overwritePlugins: false
  initializeOnce: true
  installLatestPlugins: false
  installLatestSpecifiedPlugins: false
  overwritePluginsFromImage: true
timja commented 3 years ago

can you reproduce without the backup? i.e. with just that test job?

is this running on AKS?

elkh510 commented 3 years ago

is this running on AKS?

yes

Server Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.7", GitCommit:"4966fd0dded6419fd23233a38c8905c67a3ea78e", GitTreeState:"clean", BuildDate:"2021-08-17T02:06:07Z", GoVersion:"go1.15.12", Compiler:"gc", Platform:"linux/amd64"}

can you reproduce without the backup? i.e. with just that test job?

yep but i have to deleted plugins from list

because they was installed from the file values

persistence:
  enabled: true
  storageClass: default #standard
  size: 128Gi
  mounts:
    - mountPath: /var/jenkins_backup
      name: jenkins-backup
      readOnly: false
controller:
  tag: 2.277.4-lts-jdk11
  adminSecret: true
  adminUser: "adminUser"
  adminPassword: "adminPassword"
  sidecars:
    configAutoReload:
      enabled: true
  healthProbes: true
  probes:
    startupProbe:
      failureThreshold: 5
      periodSeconds: 10
      timeoutSeconds: 600
    livenessProbe:
      failureThreshold: 5
      periodSeconds: 10
      timeoutSeconds: 600
    readinessProbe:
      failureThreshold: 3
      periodSeconds: 10
      timeoutSeconds: 5
  numExecutors: 2
  enableXmlConfig: true
  runAsUser: 0
  javaOpts: >
    -Xms1g -Xmx3g -Djava.awt.headless=true
    -Dhudson.model.DirectoryBrowserSupport.CSP="" -XX:+PrintFlagsFinal -Xdebug
    -Xrunjdwp:transport=dt_socket,server=y,address=8000,suspend=n
    -Dcom.sun.management.jmxremote=true
    -Dcom.sun.management.jmxremote.port=3000
    -Dcom.sun.management.jmxremote.rmi.port=3001
    -Djava.rmi.server.hostname=127.0.0.1
    -Dcom.sun.management.jmxremote.local.only=false
    -Dcom.sun.management.jmxremote.authenticate=false
    -Dcom.sun.management.jmxremote.ssl=false
  extraPorts:
    - name: debug-port
      port: 8000
    - name: jmxremote-port
      port: 3000
    - name: jmx-rmi-port
      port: 3001
  prometheus:
    enabled: true
    serviceMonitorAdditionalLabels:
      release: prometheus
  resources:
    requests:
      cpu: '2'
      memory: 4Gi
    limits:
      cpu: '6'
      memory: 12Gi
  ingress:
    enabled: true
    annotations:
      kubernetes.io/ingress.class: nginx
      nginx.ingress.kubernetes.io/ssl-redirect: 'true'
      cert-manager.io/cluster-issuer: letsencrypt-prod
      nginx.ingress.kubernetes.io/proxy-body-size: 100m
    hostName: jenkins.hostName.com
    tls:
      - secretName: jenkins
    hosts:
      - jenkins.hostName.com
    overwritePlugins: false
    initializeOnce: true
    installLatestPlugins: false
    installLatestSpecifiedPlugins: false
    overwritePluginsFromImage: true
    installPlugins:
      - docker-commons:1.17
      - junit:1.52
      - matrix-project:1.18
      - display-url-api:2.3.5
      - file-operations:1.11
      - scm-api:2.6.5
      - bootstrap5-api:5.1.0-3
      - blueocean-autofavorite:1.2.4
      - blueocean-personalization:1.24.8
      - jquery-detached:1.2.1
      - pipeline-model-declarative-agent:1.1.1
      - cloudbees-bitbucket-branch-source:2.9.11
      - workflow-scm-step:2.13
      - sonar:2.13.1
      - blueocean-bitbucket-pipeline:1.24.8
      - jackson2-api:2.12.4
      - jjwt-api:0.11.2-9.c8b45b8bb173
      - workflow-api:2.46
      - lockable-resources:2.11
      - variant:1.4
      - windows-slaves:1.8
      - command-launcher:1.6
      - workflow-basic-steps:2.24
      - job-dsl:1.77
      - blueocean-jira:1.24.8
      - authentication-tokens:1.4
      - bouncycastle-api:2.24
      - data-tables-api:1.10.25-3
      - authorize-project:1.4.0
      - external-monitor-job:1.7
      - antisamy-markup-formatter:2.1
      - blueocean-i18n:1.24.8
      - handy-uri-templates-2-api:2.1.8-1.0
      - script-security:1.78
      - kubernetes-credentials:0.9.0
      - plugin-util-api:2.4.0
      - font-awesome-api:5.15.4-1
      - azure-sdk:30.vf3165534d6e8
      - blueocean-pipeline-editor:1.24.8
      - blueocean-github-pipeline:1.24.8
      - pipeline-input-step:2.12
      - blueocean-pipeline-api-impl:1.24.8
      - blueocean-dashboard:1.24.8
      - extended-read-permission:3.2
      - pipeline-build-step:2.15
      - credentials:2.5
      - workflow-job:2.41
      - xunit:3.0.2
      - popper-api:1.16.1-2
      - azure-credentials:182.v3ccd4a755864
      - blueocean:1.24.8
      - pipeline-graph-analysis:1.11
      - git-changelog:3.11
      - http_request:1.11
      - git-server:1.9
      - blueocean-events:1.24.8
      - jquery:1.12.4-1
      - bootstrap4-api:4.6.0-3
      - oauth-credentials:0.4
      - structs:1.23
      - cloudbees-folder:6.16
      - build-user-vars-plugin:1.7
      - blueocean-rest-impl:1.24.8
      - cloudbees-disk-usage-simple:0.10
      - matrix-auth:2.6.8
      - pipeline-milestone-step:1.3.2
      - github-api:1.123
      - ace-editor:1.1
      - dtkit-api:3.0.0
      - sse-gateway:1.24
      - code-coverage-api:1.4.1
      - locale:1.4
      - forensics-api:1.3.0
      - pipeline-utility-steps:2.10.0
      - timestamper:1.13
      - pam-auth:1.6
      - blueocean-config:1.24.8
      - htmlpublisher:1.25
      - momentjs:1.1.1
      - pipeline-model-definition:1.9.1
      - git:4.8.2
      - github-oauth:0.33
      - next-build-number:1.6
      - pipeline-stage-step:2.5
      - workflow-cps:2.93
      - run-condition:1.5
      - jdk-tool:1.5
      - copyartifact:1.46.1
      - ant:1.11
      - maven-plugin:3.12
      - pipeline-model-api:1.9.1
      - pipeline-github:2.7
      - trilead-api:1.0.13
      - popper2-api:2.9.3-1
      - jaxb:2.3.0.1
      - kubernetes-client-api:5.4.1
      - logstash:2.4.0
      - google-oauth-plugin:1.0.6
      - slack:2.48
      - saml:2.0.8
      - pipeline-model-extensions:1.9.1
      - blueocean-web:1.24.8
      - parameterized-scheduler:1.0
      - greenballs:1.15.1
      - kubernetes:1.30.1
      - jacoco:3.3.0
      - caffeine-api:2.9.2-29.v717aac953ff3
      - git-parameter:0.9.13
      - pipeline-stage-tags-metadata:1.9.1
      - checks-api:1.7.2
      - echarts-api:5.1.2-11
      - handlebars:3.0.8
      - durable-task:1.39
      - azure-ad:180.v8b1e80e6f242
      - blueocean-commons:1.24.8
      - javadoc:1.6
      - git-client:3.9.0
      - basic-branch-build-strategies:1.3.2
      - token-macro:266.v44a80cf277fd
      - pipeline-rest-api:2.19
      - blackduck-detect:7.0.0
      - windows-azure-storage:359.v09573e5ff73f
      - blueocean-rest:1.24.8
      - blueocean-core-js:1.24.8
      - jira:3.5
      - blueocean-git-pipeline:1.24.8
      - artifactory:3.13.0
      - multibranch-build-strategy-extension:1.0.10
      - ssh-credentials:1.18.1
      - blueocean-display-url:2.4.1
      - mercurial:2.15
      - configuration-as-code:1.52
      - gradle:1.37.1
      - favorite:2.3.3
      - icon-shim:3.0.0
      - blueocean-pipeline-scm-api:1.24.8
      - workflow-aggregator:2.6
      - credentials-binding:1.27
      - autocomplete-parameter:1.0
      - jquery3-api:3.6.0-2
      - generic-webhook-trigger:1.76
      - ivy:2.1
      - workflow-support:3.8
      - pubsub-light:1.16
      - build-monitor-plugin:1.12+build.201809061734
      - docker-workflow:1.26
      - workflow-cps-global-lib:2.21
      - plain-credentials:1.7
      - github-pullrequest:0.3.0
      - ansicolor:1.0.0
      - extended-choice-parameter:0.82
      - blueocean-jwt:1.24.8
      - jenkins-design-language:1.24.8
      - ldap:2.7
      - snakeyaml-api:1.29.1
      - github:1.34.1
      - apache-httpcomponents-client-4-api:4.5.13-1.0
      - metrics:4.0.2.8
      - jsch:0.1.55.2
      - workflow-durable-task-step:2.39
      - config-file-provider:3.8.1
      - pipeline-stage-view:2.19
      - github-branch-source:2.10.4
      - github-autostatus:3.6.2
      - workflow-step-api:2.24
      - okhttp-api:3.14.9
      - multibranch-action-triggers:1.8.6
      - mailer:1.34
      - cobertura:1.16
      - branch-api:2.6.5
      - workflow-multibranch:2.26
elkh510 commented 3 years ago

hi @timja Did you manage to reproduce this issue? Or do you need some more information from me?

timja commented 3 years ago

Hi,

I haven't had time, I'm currently looking at https://github.com/jenkinsci/azure-vm-agents-plugin/issues/295 and docker images issues. This is on my list but I can't guarantee when I can get to it.

elkh510 commented 3 years ago

understand if you have some question - feel free to ping me. thank you!

panicking commented 3 years ago

Hi all

I have the problem that I can not upload large file. I can reproduce on linux

Jenkins: 2.303.1
OS: Linux - 4.18.0-305.12.1.el8_4.x86_64
---
ace-editor:1.1
ant:1.11
antisamy-markup-formatter:2.1
apache-httpcomponents-client-4-api:4.5.13-1.0
authentication-tokens:1.4
azure-artifact-manager:94.vcb8b76839313
azure-cli:0.9
azure-credentials:182.v3ccd4a755864
azure-sdk:30.vf3165534d6e8
blueocean-commons:1.24.8
blueocean-rest:1.24.8
bootstrap4-api:4.6.0-3
bootstrap5-api:5.1.0-3
bouncycastle-api:2.24
branch-api:2.6.5
build-pipeline-plugin:1.5.8
build-timeout:1.20
build-user-vars-plugin:1.8
caffeine-api:2.9.2-29.v717aac953ff3
checks-api:1.7.2
cloudbees-folder:6.16
command-launcher:1.6
conditional-buildstep:1.4.1
config-autorefresh-plugin:1.0
config-file-provider:3.8.1
configuration-as-code:1.52
copyartifact:1.46.2
create-fingerprint:1.2
credentials:2.6.1
credentials-binding:1.27
custom-tools-plugin:0.8
cvs:2.19
dashboard-view:2.17
display-url-api:2.3.5
docker-build-step:2.8
docker-commons:1.17
docker-java-api:3.1.5.2
docker-plugin:1.2.3
docker-slaves:1.0.7
docker-workflow:1.26
durable-task:1.39
echarts-api:5.1.2-11
email-ext:2.83
envinject:2.4.0
envinject-api:1.7
extended-choice-parameter:0.82
extended-read-permission:3.2
extensible-choice-parameter:1.8.0
external-monitor-job:1.7
favorite:2.3.3
font-awesome-api:5.15.4-1
gerrit-trigger:2.35.1
git:4.8.2
git-client:3.9.0
git-server:1.10
handlebars:3.0.8
handy-uri-templates-2-api:2.1.8-1.0
icon-shim:3.0.0
jackson2-api:2.12.4
javadoc:1.6
jaxb:2.3.0.1
jdk-tool:1.5
jenkins-design-language:1.24.8
jenkins-jira-plugin:3.9.0-SNAPSHOT (private-dce501b3-markrekveld)
jira:3.6
jobtemplates:1.0
jquery:1.12.4-1
jquery-detached:1.2.1
jquery-ui:1.0.2
jquery3-api:3.6.0-2
jsch:0.1.55.2
junit:1.53
ldap:2.7
lockable-resources:2.11
mailer:1.34
mapdb-api:1.0.9.0
matrix-auth:2.6.8
matrix-combinations-parameter:1.3.1
matrix-project:1.19
mattermost:3.1.1
maven-plugin:3.12
metrics:4.0.2.8
momentjs:1.1.1
multiple-scms:0.8
okhttp-api:3.14.9
pam-auth:1.6
parameterized-trigger:2.41
pipeline-build-step:2.15
pipeline-github-lib:1.0
pipeline-graph-analysis:1.11
pipeline-input-step:2.12
pipeline-milestone-step:1.3.2
pipeline-model-api:1.9.1
pipeline-model-declarative-agent:1.1.1
pipeline-model-definition:1.9.1
pipeline-model-extensions:1.9.1
pipeline-rest-api:2.19
pipeline-stage-step:2.5
pipeline-stage-tags-metadata:1.9.1
pipeline-stage-view:2.19
plain-credentials:1.7
plugin-usage-plugin:1.2
plugin-util-api:2.4.0
popper-api:1.16.1-2
popper2-api:2.9.3-1
pubsub-light:1.16
purge-build-queue-plugin:1.0
purge-job-history:1.6
resource-disposer:0.16
role-strategy:3.2.0
run-condition:1.5
saferestart:0.3
saml:2.0.8
scm-api:2.6.5
scoring-load-balancer:1.0.1
script-security:1.78
scriptler:3.3
sidebar-link:1.12.0
simple-theme-plugin:0.7
snakeyaml-api:1.29.1
sse-gateway:1.24
ssh-agent:1.23
ssh-credentials:1.19
ssh-slaves:1.33.0
sshd:3.1.0
structs:1.23
template-project:1.5.2
throttle-concurrents:2.4
timestamper:1.13
token-macro:266.v44a80cf277fd
trilead-api:1.0.13
uno-choice:2.5.6
variant:1.4
windows-azure-storage:359.v09573e5ff73f
windows-slaves:1.8
workflow-aggregator:2.6
workflow-api:2.46
workflow-basic-steps:2.24
workflow-cps:2.93
workflow-cps-global-lib:2.21
workflow-durable-task-step:2.39
workflow-job:2.41
workflow-multibranch:2.26
workflow-scm-step:2.13
workflow-step-api:2.24
workflow-support:3.8
ws-cleanup:0.39

def doTest() {
    stage("testArtifactUpload") {
        sh 'id'
        echo "Creating dummy files"
        sh 'dd if=/dev/zero of=./file1 bs=1024K count=500'

        uploadArtifacts "file1"

        cleanWs cleanWhenFailure: false, cleanWhenNotBuilt: false, notFailBuild: true
    }
}

def branches = [
    builder01: {node('builder01') { doTest() } },
]

parallel branches
elopsod commented 3 years ago

hi all have the same problem does this issue have some ETA? @timja pls

timja commented 3 years ago

I'll do my best to take a look this week

timja commented 3 years ago

Hmm I wasn't able to reproduce with the above pipeline although I did find an issue with large files which will be fixed in https://github.com/jenkinsci/azure-storage-plugin/pull/198.

Is someone able to test if this build fixes it: https://repo.jenkins-ci.org/incrementals/org/jenkins-ci/plugins/jackson2-api/2.12.5-rc208.8a13e6539d2e/jackson2-api-2.12.5-rc208.8a13e6539d2e.hpi

elkh510 commented 3 years ago

hi @timja

Is someone able to test if this build fixes it: https://repo.jenkins-ci.org/incrementals/org/jenkins-ci/plugins/jackson2-api/2.12.5-rc208.8a13e6539d2e/jackson2-api-2.12.5-rc208.8a13e6539d2e.hpi

got same error

Hmm I wasn't able to reproduce with the above pipeline although I did find an issue with large files which will be fixed in #198.

maybe quick call ? or you can do follow to reproduce

helm3 upgrade jnk-ng1 jenkins/jenkins -f jnk-ng.values.yaml --version 3.5.1 --install --namespace jnk-ng1 --wait --timeout 20m

jnk-ng.values.yaml

persistence:
  enabled: true
  storageClass: default #standard
  size: 128Gi
controller:
  tag: 2.277.4-lts-jdk11
  adminSecret: true
  adminUser: "adminUser"
  adminPassword: "adminPassword"
  sidecars:
    configAutoReload:
      enabled: true
  healthProbes: true
  probes:
    startupProbe:
      failureThreshold: 5
      periodSeconds: 10
      timeoutSeconds: 600a
    livenessProbe:
      failureThreshold: 5
      periodSeconds: 10
      timeoutSeconds: 600
    readinessProbe:
      failureThreshold: 3
      periodSeconds: 10
      timeoutSeconds: 5
  numExecutors: 2
  enableXmlConfig: true
  runAsUser: 0
  javaOpts: >
    -Xms1g -Xmx3g -Djava.awt.headless=true
    -Dhudson.model.DirectoryBrowserSupport.CSP="" -XX:+PrintFlagsFinal -Xdebug
    -Xrunjdwp:transport=dt_socket,server=y,address=8000,suspend=n
    -Dcom.sun.management.jmxremote=true
    -Dcom.sun.management.jmxremote.port=3000
    -Dcom.sun.management.jmxremote.rmi.port=3001
    -Djava.rmi.server.hostname=127.0.0.1
    -Dcom.sun.management.jmxremote.local.only=false
    -Dcom.sun.management.jmxremote.authenticate=false
    -Dcom.sun.management.jmxremote.ssl=false
  extraPorts:
    - name: debug-port
      port: 8000
    - name: jmxremote-port
      port: 3000
    - name: jmx-rmi-port
      port: 3001
  prometheus:
    enabled: true
    serviceMonitorAdditionalLabels:
      release: prometheus
  resources:
    requests:
      cpu: '2'
      memory: 4Gi
    limits:
      cpu: '6'
      memory: 12Gi
  ingress:
    enabled: true
    annotations:
      kubernetes.io/ingress.class: nginx
      nginx.ingress.kubernetes.io/ssl-redirect: 'true'
      cert-manager.io/cluster-issuer: letsencrypt-prod
      nginx.ingress.kubernetes.io/proxy-body-size: 100m
    hostName: jenkins.hostname.com
    tls:
      - secretName: jenkins
    hosts:
      - jenkins.hostname.com
  overwritePlugins: false
  initializeOnce: true
  installLatestPlugins: false
  installLatestSpecifiedPlugins: false
  overwritePluginsFromImage: true
  installPlugins:
    - docker-commons:1.17
    - junit:1.52
    - matrix-project:1.18
    - display-url-api:2.3.5
    - file-operations:1.11
    - scm-api:2.6.5
    - bootstrap5-api:5.1.0-3
    - blueocean-autofavorite:1.2.4
    - blueocean-personalization:1.24.8
    - jquery-detached:1.2.1
    - pipeline-model-declarative-agent:1.1.1
    - cloudbees-bitbucket-branch-source:2.9.11
    - workflow-scm-step:2.13
    - sonar:2.13.1
    - blueocean-bitbucket-pipeline:1.24.8
    - jackson2-api:2.12.4
    - jjwt-api:0.11.2-9.c8b45b8bb173
    - workflow-api:2.46
    - lockable-resources:2.11
    - variant:1.4
    - windows-slaves:1.8
    - command-launcher:1.6
    - workflow-basic-steps:2.24
    - job-dsl:1.77
    - blueocean-jira:1.24.8
    - authentication-tokens:1.4
    - bouncycastle-api:2.24
    - data-tables-api:1.10.25-3
    - authorize-project:1.4.0
    - external-monitor-job:1.7
    - antisamy-markup-formatter:2.1
    - blueocean-i18n:1.24.8
    - handy-uri-templates-2-api:2.1.8-1.0
    - script-security:1.78
    - kubernetes-credentials:0.9.0
    - plugin-util-api:2.4.0
    - font-awesome-api:5.15.4-1
    - azure-sdk:30.vf3165534d6e8
    - blueocean-pipeline-editor:1.24.8
    - blueocean-github-pipeline:1.24.8
    - pipeline-input-step:2.12
    - blueocean-pipeline-api-impl:1.24.8
    - blueocean-dashboard:1.24.8
    - extended-read-permission:3.2
    - pipeline-build-step:2.15
    - credentials:2.5
    - workflow-job:2.41
    - xunit:3.0.2
    - popper-api:1.16.1-2
    - azure-credentials:182.v3ccd4a755864
    - blueocean:1.24.8
    - pipeline-graph-analysis:1.11
    - git-changelog:3.11
    - http_request:1.11
    - git-server:1.9
    - blueocean-events:1.24.8
    - jquery:1.12.4-1
    - bootstrap4-api:4.6.0-3
    - oauth-credentials:0.4
    - structs:1.23
    - cloudbees-folder:6.16
    - build-user-vars-plugin:1.7
    - blueocean-rest-impl:1.24.8
    - cloudbees-disk-usage-simple:0.10
    - matrix-auth:2.6.8
    - pipeline-milestone-step:1.3.2
    - github-api:1.123
    - ace-editor:1.1
    - dtkit-api:3.0.0
    - sse-gateway:1.24
    - code-coverage-api:1.4.1
    - locale:1.4
    - forensics-api:1.3.0
    - pipeline-utility-steps:2.10.0
    - timestamper:1.13
    - pam-auth:1.6
    - blueocean-config:1.24.8
    - htmlpublisher:1.25
    - momentjs:1.1.1
    - pipeline-model-definition:1.9.1
    - git:4.8.2
    - github-oauth:0.33
    - next-build-number:1.6
    - pipeline-stage-step:2.5
    - workflow-cps:2.93
    - run-condition:1.5
    - jdk-tool:1.5
    - copyartifact:1.46.1
    - ant:1.11
    - maven-plugin:3.12
    - pipeline-model-api:1.9.1
    - pipeline-github:2.7
    - trilead-api:1.0.13
    - popper2-api:2.9.3-1
    - jaxb:2.3.0.1
    - kubernetes-client-api:5.4.1
    - logstash:2.4.0
    - google-oauth-plugin:1.0.6
    - slack:2.48
    - saml:2.0.8
    - pipeline-model-extensions:1.9.1
    - blueocean-web:1.24.8
    - parameterized-scheduler:1.0
    - greenballs:1.15.1
    - kubernetes:1.30.1
    - jacoco:3.3.0
    - caffeine-api:2.9.2-29.v717aac953ff3
    - git-parameter:0.9.13
    - pipeline-stage-tags-metadata:1.9.1
    - checks-api:1.7.2
    - echarts-api:5.1.2-11
    - handlebars:3.0.8
    - durable-task:1.39
    - azure-ad:180.v8b1e80e6f242
    - blueocean-commons:1.24.8
    - javadoc:1.6
    - git-client:3.9.0
    - basic-branch-build-strategies:1.3.2
    - token-macro:266.v44a80cf277fd
    - pipeline-rest-api:2.19
    - blackduck-detect:7.0.0
    - windows-azure-storage:359.v09573e5ff73f
    - blueocean-rest:1.24.8
    - blueocean-core-js:1.24.8
    - jira:3.5
    - blueocean-git-pipeline:1.24.8
    - artifactory:3.13.0
    - multibranch-build-strategy-extension:1.0.10
    - ssh-credentials:1.18.1
    - blueocean-display-url:2.4.1
    - mercurial:2.15
    - configuration-as-code:1.52
    - gradle:1.37.1
    - favorite:2.3.3
    - icon-shim:3.0.0
    - blueocean-pipeline-scm-api:1.24.8
    - workflow-aggregator:2.6
    - credentials-binding:1.27
    - autocomplete-parameter:1.0
    - jquery3-api:3.6.0-2
    - generic-webhook-trigger:1.76
    - ivy:2.1
    - workflow-support:3.8
    - pubsub-light:1.16
    - build-monitor-plugin:1.12+build.201809061734
    - docker-workflow:1.26
    - workflow-cps-global-lib:2.21
    - plain-credentials:1.7
    - github-pullrequest:0.3.0
    - ansicolor:1.0.0
    - extended-choice-parameter:0.82
    - blueocean-jwt:1.24.8
    - jenkins-design-language:1.24.8
    - ldap:2.7
    - snakeyaml-api:1.29.1
    - github:1.34.1
    - apache-httpcomponents-client-4-api:4.5.13-1.0
    - metrics:4.0.2.8
    - jsch:0.1.55.2
    - workflow-durable-task-step:2.39
    - config-file-provider:3.8.1
    - pipeline-stage-view:2.19
    - github-branch-source:2.10.4
    - github-autostatus:3.6.2
    - workflow-step-api:2.24
    - okhttp-api:3.14.9
    - multibranch-action-triggers:1.8.6
    - mailer:1.34
    - cobertura:1.16
    - branch-api:2.6.5
    - workflow-multibranch:2.26

pipeline

node('master') {
    deleteDir()
    script{
        String randomString = org.apache.commons.lang.RandomStringUtils.random(9, true, true)
        def j = "kk${randomString}k.txt"
    sh """
        dd if=/dev/urandom of=${j} bs=1MB count=768
        du -sh ${j} # 240mb
    """
    azureUpload containerName: 'jenkins-backup', filesPath: j, storageCredentialId: "bkp", storageType: 'blobstorage'
    }
}
timja commented 3 years ago

thanks, I'll try that later on, I did use the pipeline in my setup and it worked

molesmoke commented 3 years ago

Just to chime in that I'm also seeing this issue, running the latest Jenkins Docker LTS (jenkins/jenkins:lts-jdk11 2.303.1) with all the latest plugins. Downgrading to 1.1.7 just gave different errors for me :(

Hope someone here is able to fix it! Thanks for your efforts!

timja commented 3 years ago

I can reproduce it with the helm example, thanks

timja commented 3 years ago

I can't reproduce this on 2.311

Looks like this was fixed in https://github.com/jenkinsci/jenkins/pull/5651, which first appeared in 2.307.

I would recommend you also use https://repo.jenkins-ci.org/incrementals/org/jenkins-ci/plugins/jackson2-api/2.12.5-rc208.8a13e6539d2e/jackson2-api-2.12.5-rc208.8a13e6539d2e.hpi as there's another bug you'll likely hit if you don't.

I attached a debugger and ran:

_xmlWriter.getClass().getProtectionDomain().getCodeSource();

Which returned: file:/var/jenkins_home/war/WEB-INF/lib/wstx-asl-3.2.9.jar

Showing that it was from the Jenkins war.

I'll close this now, unfortunately there's not much I can do about this. I don't know why the code only goes down this path in some setups, I attached a debugger to my local instance and it never seems to enter that close method. Possibly some other plugin is affecting the jackson plugin in some way.

cc @basil as you'll probably be interested