search

timja / jenkins-gh-issues-poc-06-18

0 stars 0 forks source link

[JENKINS-54121] Renaming jobs casue Jenkins crash #4060

Open timja opened 6 years ago

timja commented 6 years ago

When I try to rename job Jenkins is down.

Originally reported by mesmero, imported from: Renaming jobs casue Jenkins crash
  • status: Reopened
  • priority: Critical
  • resolution: Unresolved
  • imported: 2022/01/10
timja commented 6 years ago

danielbeck:

This can be caused by any number of causes, such as plugins badly handling job rename notifications. Please provide a thread dump from after renaming so we can see what's keeping Jenkins busy.

timja commented 5 years ago

mesmero:

not important anymore

timja commented 5 years ago

iceiceice:

Hi danielbeck

I have same issue,  jenkins 2.176.1, user tried to rename a folder containing 2 millions files

jenkins heap of 31 Gb become full and jenkins died in gc

 

trace is 

"Handling POST /job/Avolin/job/Tradebeam/job/GTM-2/confirmRename from 10.212.255.245 : qtp1254526270-61611" #61611 prio=5 os_prio=0 tid=0x00007f60801c6800 nid=0x3ee0 runnable [0x00007f601d863000]"Handling POST /job/Avolin/job/Tradebeam/job/GTM-2/confirmRename from 10.212.255.245 : qtp1254526270-61611" #61611 prio=5 os_prio=0 tid=0x00007f60801c6800 nid=0x3ee0 runnable [0x00007f601d863000]   java.lang.Thread.State: RUNNABLE at java.util.HashMap.putVal(HashMap.java:631) at java.util.HashMap.put(HashMap.java:612) at org.apache.tools.ant.util.LinkedHashtable.put(LinkedHashtable.java:110) - locked <0x00007f624dfde3e0> (a org.apache.tools.ant.util.LinkedHashtable) at org.apache.tools.ant.taskdefs.Copy.buildMap(Copy.java:788) at org.apache.tools.ant.taskdefs.Copy.scan(Copy.java:735) at org.apache.tools.ant.taskdefs.Copy.iterateOverBaseDirs(Copy.java:660) at org.apache.tools.ant.taskdefs.Copy.execute(Copy.java:559) at hudson.model.AbstractItem.renameTo(AbstractItem.java:423) - locked <0x00007f621d7a18f8> (a com.cloudbees.hudson.plugins.folder.Folder) - locked <0x00007f6216b530b0> (a com.cloudbees.hudson.plugins.folder.Folder) at com.cloudbees.hudson.plugins.folder.AbstractFolder.renameTo(AbstractFolder.java:1305) at hudson.model.AbstractItem.doConfirmRename(AbstractItem.java:264) at java.lang.invoke.LambdaForm$DMH/769287236.invokeVirtual_LL_L(LambdaForm$DMH) at java.lang.invoke.LambdaForm$BMH/1605795346.reinvoke(LambdaForm$BMH) at java.lang.invoke.LambdaForm$MH/21979174.invoker(LambdaForm$MH) at java.lang.invoke.LambdaForm$MH/293294444.invokeExact_MT(LambdaForm$MH) at java.lang.invoke.MethodHandle.invokeWithArguments(MethodHandle.java:627) at org.kohsuke.stapler.Function$MethodFunction.invoke(Function.java:396) at org.kohsuke.stapler.Function$InstanceFunction.invoke(Function.java:408) at org.kohsuke.stapler.interceptor.RequirePOST$Processor.invoke(RequirePOST.java:77) at org.kohsuke.stapler.PreInvokeInterceptedFunction.invoke(PreInvokeInterceptedFunction.java:26) at org.kohsuke.stapler.Function.bindAndInvoke(Function.java:212) at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:145) at org.kohsuke.stapler.MetaClass$11.doDispatch(MetaClass.java:535) at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58) at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:747) at org.kohsuke.stapler.Stapler.invoke(Stapler.java:878)

here is a shot from MAT , report archive attached

timja commented 5 years ago

qinling:

My instance also has this problem. I am not sure it is exactly the same with the issue here. But I believe it is caused by renaming. There were 2 renaming operations caused Jenkins not responding in 2 hours.

Jenkins 2.176.1