search

jenkins-infra / helpdesk

Open your Infrastructure related issues here for the Jenkins project
https://github.com/jenkins-infra/helpdesk/issues/new/choose
17 stars 10 forks source link

[INFRA-1152] Jira was down #917

Closed jenkins-infra-bot closed 7 years ago

jenkins-infra-bot commented 7 years ago

Today I had to restart JIRA because it was down:

 

java.lang.OutOfMemoryError: GC overhead limit exceeded
Originally reported by aheritier, imported from: Jira was down
  • assignee: rtyler
  • status: Closed
  • priority: Major
  • resolution: Fixed
  • resolved: 2017-08-02T22:32:23+02:00
  • imported: 2022/01/10
jenkins-infra-bot commented 7 years ago

aheritier:

Another one few minutes ago.

The instance is also impacted a lot by https://jira.atlassian.com/browse/JRASERVER-64095

2017-04-24 13:01:54,940 http-nio-8080-exec-108 ERROR anonymous 781x3389x149 - 141.8.143.231,172.17.0.1 /browse/JENKINS-43208 [c.a.p.webresource.assembler.DefaultWebResourceAssembler] Error generating bigpipe content for 'sidebar-id': Deadline exceeded
java.lang.RuntimeException: Deadline exceeded
at com.atlassian.plugin.webresource.bigpipe.QueueFutureCompletionService.forceCompleteAll(QueueFutureCompletionService.java:62)
at com.atlassian.plugin.webresource.bigpipe.BigPipe.forceCompleteAll(BigPipe.java:33)
at com.atlassian.plugin.webresource.assembler.DefaultWebResourceAssembler$1.drainBigPipe(DefaultWebResourceAssembler.java:116)
at com.atlassian.plugin.webresource.assembler.DefaultWebResourceAssembler$1.resolve(DefaultWebResourceAssembler.java:94)
at com.atlassian.plugin.webresource.assembler.DefaultWebResourceAssembler$1.drainOrPoll(DefaultWebResourceAssembler.java:75)
at com.atlassian.plugin.webresource.assembler.DefaultWebResourceAssembler$1.drainIncludedResources(DefaultWebResourceAssembler.java:66)
at com.atlassian.jira.plugin.navigation.HeaderFooterRendering.flushBigPipe(HeaderFooterRendering.java:128)
at jsp.decorators.general_002dbody_002dpost_jsp._jspService(general_002dbody_002dpost_jsp.java:86)
at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
... 25 filtered
at com.atlassian.jira.web.pagebuilder.AbstractJspDecorator.writeTemplate(AbstractJspDecorator.java:93)
at com.atlassian.jira.web.pagebuilder.AbstractJspDecorator.writePostBody(AbstractJspDecorator.java:85)
at com.atlassian.jira.web.pagebuilder.DefaultPageBuilder.finish(DefaultPageBuilder.java:120)
... 21 filtered
at com.atlassian.jira.projects.legacy.LegacyRedirectFilter.handleErrorExtractingUrlComponents(LegacyRedirectFilter.java:89)
at com.atlassian.jira.projects.legacy.LegacyRedirectFilter.doFilter(LegacyRedirectFilter.java:61)
... 15 filtered
at com.atlassian.jira.security.JiraSecurityFilter.lambda$doFilter$0(JiraSecurityFilter.java:76)
... 1 filtered
at com.atlassian.jira.security.JiraSecurityFilter.doFilter(JiraSecurityFilter.java:74)
... 40 filtered
at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
... 10 filtered
at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
... 4 filtered
at com.atlassian.web.servlet.plugin.LocationCleanerFilter.doFilter(LocationCleanerFilter.java:36)
... 29 filtered
at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
... 28 filtered
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)

 

2017-04-24 13:03:04,417 http-nio-8080-exec-44 INFO anonymous 782x6256x111 - 195.29.221.170,172.17.0.1 /browse/JENKINS-38706 [c.a.j.plugin.navigation.HeaderFooterRendering] Bigpipe taking longer than 5s
2017-04-24 13:03:04,600 http-nio-8080-exec-44 INFO anonymous 782x6256x111 - 195.29.221.170,172.17.0.1 /browse/JENKINS-38706 [c.a.j.plugin.navigation.HeaderFooterRendering] Bigpipe taking longer than 5s
2017-04-24 13:03:04,743 http-nio-8080-exec-2 INFO anonymous 782x6259x113 - 195.212.29.181,172.17.0.1 /browse/JENKINS-13140 [c.a.j.plugin.navigation.HeaderFooterRendering] Bigpipe taking longer than 5s
2017-04-24 13:03:04,812 http-nio-8080-exec-2 INFO anonymous 782x6259x113 - 195.212.29.181,172.17.0.1 /browse/JENKINS-13140 [c.a.j.plugin.navigation.HeaderFooterRendering] Bigpipe taking longer than 5s
jenkins-infra-bot commented 7 years ago

aheritier:

cc Oleg Nenashev who reported the issue to me

jenkins-infra-bot commented 7 years ago

oleg_nenashev:

Created INFRA-1178

jenkins-infra-bot commented 7 years ago

aheritier:

Another one cc R. Tyler Croy Oleg Nenashev Olivier Vernin

 

2017-05-15 01:28:43,581 http-nio-8080-exec-92 ERROR anonymous 1408x1029854x14 - 203.0.215.2,172.17.0.1 /browse/JENKINS-21480 [o.a.c.c.C.[.[localhost].[/].[action]] Servlet.service() for servlet action threw exception
java.lang.OutOfMemoryError: Java heap space
2017-05-15 02:04:30,291 http-nio-8080-exec-172 INFO anonymous 25x1029876x34 - 68.180.229.229,172.17.0.1 /secure/VoteOrWatchIssue.jspa [c.a.j.web.action.XsrfErrorAction] The security token is missing for 'anonymous'. User-Agent : 'Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)'
at com.atlassian.jira.webwork.JiraSafeActionParameterSetter.setSafeParameters(JiraSafeActionParameterSetter.java:118)
at com.atlassian.jira.config.webwork.JiraActionFactory$SafeParameterSettingActionFactoryProxy.setActionParameters(JiraActionFactory.java:236)
at com.atlassian.jira.config.webwork.JiraActionFactory$SafeParameterSettingActionFactoryProxy.getActionImpl(JiraActionFactory.java:151)
at webwork.action.factory.ChainingActionFactoryProxy.getActionImpl(ChainingActionFactoryProxy.java:53)
at com.atlassian.jira.config.webwork.JiraActionFactory.getActionImpl(JiraActionFactory.java:301)
at webwork.dispatcher.GenericDispatcher.executeAction(GenericDispatcher.java:141)
at com.atlassian.jira.web.dispatcher.JiraWebworkActionDispatcher.service(JiraWebworkActionDispatcher.java:141)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)
at com.atlassian.jira.web.filters.JiraLastFilter.lambda$doFilter$0(JiraLastFilter.java:35)
at com.atlassian.jira.web.filters.JiraLastFilter$$Lambda$436/1499319056.doFilter(Unknown Source)
at com.atlassian.jira.web.filters.steps.ChainedFilterStepRunner.doFilter(ChainedFilterStepRunner.java:62)
at com.atlassian.jira.web.filters.JiraLastFilter.doFilter(JiraLastFilter.java:33)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)
2017-05-15 01:33:41,035 http-nio-8080-exec-147 ERROR anonymous 1409x1029857x17 - 192.30.252.34,172.17.0.1 /rest/bitbucket/1.0/repository/6276/sync [c.a.p.r.c.error.jersey.ThrowableExceptionMapper] Uncaught exception thrown by REST service: Java heap space
java.lang.OutOfMemoryError: Java heap space
at com.atlassian.jira.web.filters.XContentTypeOptionsNoSniffFilter.doFilter(XContentTypeOptionsNoSniffFilter.java:20)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:32)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192)

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "http-nio-8080-exec-205"
Exception in thread "http-nio-8080-exec-202" at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
Exception in thread "httpclient-io:thread-1" java.lang.OutOfMemoryError: Java heap space
Exception in thread "http-nio-8080-exec-215" java.lang.OutOfMemoryError: Java heap space
2017-05-15 00:06:10,519 ContainerBackgroundProcessor[StandardEngine[Catalina]] ERROR [c.a.event.internal.AsynchronousAbleEventDispatcher] There was an exception thrown trying to dispatch event [com.atlassian.sal.api.events.SessionDestroyedEvent@e343566] from the invoker [SingleParameterMethodListenerInvoker{method=public void com.atlassian.analytics.client.listener.JiraEventListener.onEvent(java.lang.Object), listener=com.atlassian.analytics.client.listener.JiraEventListener@5723fe59}]
java.lang.RuntimeException: Java heap space
at com.atlassian.event.internal.SingleParameterMethodListenerInvoker.invoke(SingleParameterMethodListenerInvoker.java:54)
at com.atlassian.event.internal.AsynchronousAbleEventDispatcher$1$1.run(AsynchronousAbleEventDispatcher.java:48)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutorService.execute(MoreExecutors.java:299)
at com.atlassian.event.internal.AsynchronousAbleEventDispatcher.dispatch(AsynchronousAbleEventDispatcher.java:107)
at com.atlassian.event.internal.EventPublisherImpl.invokeListeners(EventPublisherImpl.java:160)
at com.atlassian.event.internal.EventPublisherImpl.publish(EventPublisherImpl.java:79)
at com.atlassian.jira.web.session.currentusers.JiraUserSessionDestroyListener.destroySession(JiraUserSessionDestroyListener.java:53)
at com.atlassian.jira.web.session.currentusers.JiraUserSessionDestroyListener.sessionDestroyed(JiraUserSessionDestroyListener.java:43)
... 9 filtered
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-05-15 00:43:54,799 http-nio-8080-exec-57 ERROR anonymous 1407x1029842x3 - 207.46.13.144,172.17.0.1 /browse/JENKINS-11993 [o.a.c.c.C.[.[.[.[jsp.decorators.general_002dbody_002dpost_jsp]] Servlet.service() for servlet jsp.decorators.general_002dbody_002dpost_jsp threw exception
java.lang.IllegalStateException: Cannot create a session after the response has been committed
2017-05-15 05:45:12,937 http-nio-8080-exec-57 ERROR anonymous 1407x1029842x3 - 207.46.13.144,172.17.0.1 /browse/JENKINS-11993 [c.a.j.web.filters.CommittedResponseHtmlErrorRecoveryFilter] Exception occurred after HTTP response was already committed: javax.servlet.ServletException: java.lang.IllegalStateException: Cannot create a session after the response has been committed
Exception in thread "http-nio-8080-exec-187" java.lang.OutOfMemoryError: Java heap space: failed reallocation of scalar replaced objects
jenkins-infra-bot commented 7 years ago

aheritier:

Restarted ~1h ago too

 

2017-05-17 05:07:14,215 http-nio-8080-exec-65 ERROR anonymous 307x2088443x7 1uzow4p 76.14.28.105,172.17.0.1 /s/ec4e330e30a4b5a8309d5f4b05baaa6f-CDN/p3tl5/73011/7aff54c3bfaacd21320cf3b493f5a645/37349e9a9cbfc01728a437b4360de3e8/_/download/contextbatch/js/_super/batch.js [o.a.c.c.C.[.[localhost].[/].[file-server]] Servlet.service() for servlet file-server threw exception
java.lang.RuntimeException: org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe
at com.atlassian.plugin.cache.filecache.impl.StreamsCache.streamFromFile(StreamsCache.java:113)
at com.atlassian.plugin.cache.filecache.impl.OneStreamCache.stream(OneStreamCache.java:54)
at com.atlassian.plugin.cache.filecache.impl.FileCacheImpl.cache(FileCacheImpl.java:87)
at com.atlassian.plugin.webresource.impl.http.Controller.sendCachedInProduction(Controller.java:319)
at com.atlassian.plugin.webresource.impl.http.Controller.sendCached(Controller.java:282)
at com.atlassian.plugin.webresource.impl.http.Controller.serveResources(Controller.java:222)
at com.atlassian.plugin.webresource.impl.http.Controller.serveBatch(Controller.java:84)
at com.atlassian.plugin.webresource.impl.http.Router$5.apply(Router.java:78)
at com.atlassian.plugin.webresource.impl.http.Router$5.apply(Router.java:71)
at com.atlassian.plugin.webresource.impl.support.http.BaseRouter.callHandler(BaseRouter.java:169)
at com.atlassian.plugin.webresource.impl.support.http.BaseRouter.dispatch(BaseRouter.java:144)
at com.atlassian.plugin.webresource.servlet.PluginResourceDownload.serveFile(PluginResourceDownload.java:65)
at com.atlassian.plugin.servlet.AbstractFileServerServlet.doGet(AbstractFileServerServlet.java:28)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:622)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
... 48 filtered
at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
... 39 filtered
at com.atlassian.jira.security.JiraSecurityFilter.lambda$doFilter$0(JiraSecurityFilter.java:76)
... 1 filtered
at com.atlassian.jira.security.JiraSecurityFilter.doFilter(JiraSecurityFilter.java:74)
... 24 filtered
at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
... 12 filtered
at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
... 7 filtered
at com.atlassian.jira.plugin.webresource.CachingResourceDownloadRewriteRule$1.execute(CachingResourceDownloadRewriteRule.java:60)
at org.tuckey.web.filters.urlrewrite.RewrittenUrlClass.doRewrite(RewrittenUrlClass.java:61)
... 6 filtered
at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
... 10 filtered
at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
... 4 filtered
at com.atlassian.web.servlet.plugin.LocationCleanerFilter.doFilter(LocationCleanerFilter.java:36)
... 29 filtered
at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
... 28 filtered
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe
at org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:380)
at org.apache.tomcat.util.buf.ByteChunk.flushBuffer(ByteChunk.java:420)
at org.apache.tomcat.util.buf.ByteChunk.append(ByteChunk.java:345)
at org.apache.catalina.connector.OutputBuffer.writeBytes(OutputBuffer.java:405)
at org.apache.catalina.connector.OutputBuffer.write(OutputBuffer.java:393)
at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1384)
at com.atlassian.plugin.cache.filecache.impl.StreamsCache.streamFromFile(StreamsCache.java:110)
... 237 more
Caused by: java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
... 10 filtered
... 244 more
2017-05-17 05:07:24,508 http-nio-8080-exec-65 ERROR [o.a.c.c.C.[.[localhost].[/].[noopservlet]] Servlet.service() for servlet [noopservlet] in context with path [] threw exception
java.lang.RuntimeException: org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe
at com.atlassian.plugin.cache.filecache.impl.StreamsCache.streamFromFile(StreamsCache.java:113)
at com.atlassian.plugin.cache.filecache.impl.OneStreamCache.stream(OneStreamCache.java:54)
at com.atlassian.plugin.cache.filecache.impl.FileCacheImpl.cache(FileCacheImpl.java:87)
at com.atlassian.plugin.webresource.impl.http.Controller.sendCachedInProduction(Controller.java:319)
at com.atlassian.plugin.webresource.impl.http.Controller.sendCached(Controller.java:282)
at com.atlassian.plugin.webresource.impl.http.Controller.serveResources(Controller.java:222)
at com.atlassian.plugin.webresource.impl.http.Controller.serveBatch(Controller.java:84)
at com.atlassian.plugin.webresource.impl.http.Router$5.apply(Router.java:78)
at com.atlassian.plugin.webresource.impl.http.Router$5.apply(Router.java:71)
at com.atlassian.plugin.webresource.impl.support.http.BaseRouter.callHandler(BaseRouter.java:169)
at com.atlassian.plugin.webresource.impl.support.http.BaseRouter.dispatch(BaseRouter.java:144)
at com.atlassian.plugin.webresource.servlet.PluginResourceDownload.serveFile(PluginResourceDownload.java:65)
at com.atlassian.plugin.servlet.AbstractFileServerServlet.doGet(AbstractFileServerServlet.java:28)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:622)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
... 48 filtered
at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
... 39 filtered
at com.atlassian.jira.security.JiraSecurityFilter.lambda$doFilter$0(JiraSecurityFilter.java:76)
... 1 filtered
at com.atlassian.jira.security.JiraSecurityFilter.doFilter(JiraSecurityFilter.java:74)
... 24 filtered
at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
... 12 filtered
at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
... 7 filtered
at com.atlassian.jira.plugin.webresource.CachingResourceDownloadRewriteRule$1.execute(CachingResourceDownloadRewriteRule.java:60)
at org.tuckey.web.filters.urlrewrite.RewrittenUrlClass.doRewrite(RewrittenUrlClass.java:61)
... 6 filtered
at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
... 10 filtered
at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
... 4 filtered
at com.atlassian.web.servlet.plugin.LocationCleanerFilter.doFilter(LocationCleanerFilter.java:36)
... 29 filtered
at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
... 28 filtered
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe
at org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:380)
at org.apache.tomcat.util.buf.ByteChunk.flushBuffer(ByteChunk.java:420)
at org.apache.tomcat.util.buf.ByteChunk.append(ByteChunk.java:345)
at org.apache.catalina.connector.OutputBuffer.writeBytes(OutputBuffer.java:405)
at org.apache.catalina.connector.OutputBuffer.write(OutputBuffer.java:393)
at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1384)
at com.atlassian.plugin.cache.filecache.impl.StreamsCache.streamFromFile(StreamsCache.java:110)
... 237 more
Caused by: java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
... 10 filtered
... 244 more
2017-05-17 05:07:52,604 http-nio-8080-exec-138 ERROR anonymous 306x2088418x8 - 125.16.3.251,172.17.0.1 /browse/JENKINS-35214 [c.a.p.webresource.assembler.DefaultWebResourceAssembler] Error generating bigpipe content for 'sidebar-id': Deadline exceeded
java.lang.RuntimeException: Deadline exceeded
at com.atlassian.plugin.webresource.bigpipe.QueueFutureCompletionService.forceCompleteAll(QueueFutureCompletionService.java:62)
at com.atlassian.plugin.webresource.bigpipe.BigPipe.forceCompleteAll(BigPipe.java:33)
at com.atlassian.plugin.webresource.assembler.DefaultWebResourceAssembler$1.drainBigPipe(DefaultWebResourceAssembler.java:116)
at com.atlassian.plugin.webresource.assembler.DefaultWebResourceAssembler$1.resolve(DefaultWebResourceAssembler.java:94)
at com.atlassian.plugin.webresource.assembler.DefaultWebResourceAssembler$1.drainOrPoll(DefaultWebResourceAssembler.java:75)
at com.atlassian.plugin.webresource.assembler.DefaultWebResourceAssembler$1.drainIncludedResources(DefaultWebResourceAssembler.java:66)
at com.atlassian.jira.plugin.navigation.HeaderFooterRendering.flushBigPipe(HeaderFooterRendering.java:128)
at jsp.decorators.general_002dbody_002dpost_jsp._jspService(general_002dbody_002dpost_jsp.java:86)
at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
... 25 filtered
at com.atlassian.jira.web.pagebuilder.AbstractJspDecorator.writeTemplate(AbstractJspDecorator.java:93)
at com.atlassian.jira.web.pagebuilder.AbstractJspDecorator.writePostBody(AbstractJspDecorator.java:85)
at com.atlassian.jira.web.pagebuilder.DefaultPageBuilder.finish(DefaultPageBuilder.java:120)
... 21 filtered
at com.atlassian.jira.projects.legacy.LegacyRedirectFilter.handleErrorExtractingUrlComponents(LegacyRedirectFilter.java:89)
at com.atlassian.jira.projects.legacy.LegacyRedirectFilter.doFilter(LegacyRedirectFilter.java:61)
... 15 filtered
at com.atlassian.jira.security.JiraSecurityFilter.lambda$doFilter$0(JiraSecurityFilter.java:76)
... 1 filtered
at com.atlassian.jira.security.JiraSecurityFilter.doFilter(JiraSecurityFilter.java:74)
... 40 filtered
at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
... 10 filtered
at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
... 4 filtered
at com.atlassian.web.servlet.plugin.LocationCleanerFilter.doFilter(LocationCleanerFilter.java:36)
... 29 filtered
at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
... 28 filtered
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Exception in thread "Caesium-1-2" java.lang.OutOfMemoryError: Java heap space
at java.io.BufferedReader.(BufferedReader.java:105)
at java.io.BufferedReader.(BufferedReader.java:116)
at java.io.LineNumberReader.(LineNumberReader.java:72)
at org.apache.log4j.DefaultThrowableRenderer.render(DefaultThrowableRenderer.java:64)
at org.apache.log4j.spi.ThrowableInformation.getThrowableStrRep(ThrowableInformation.java:87)
at com.atlassian.logging.log4j.StackTraceInfo.buildNoPackagingRepresentation(StackTraceInfo.java:134)
at com.atlassian.logging.log4j.StackTraceInfo.buildThrowableStrRep(StackTraceInfo.java:110)
at com.atlassian.logging.log4j.StackTraceInfo.(StackTraceInfo.java:43)
at com.atlassian.logging.log4j.NewLineIndentingFilteringPatternLayout.getThrowableStrRep(NewLineIndentingFilteringPatternLayout.java:47)
at com.atlassian.logging.log4j.FilteredPatternLayout.formatStackTrace(FilteredPatternLayout.java:336)
at com.atlassian.logging.log4j.FilteredPatternLayout.format(FilteredPatternLayout.java:330)
at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:310)
at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
at org.apache.log4j.Category.callAppenders(Category.java:206)
at org.apache.log4j.Category.forcedLog(Category.java:391)
at org.apache.log4j.Category.log(Category.java:856)
at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:540)
at com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.executeJob(SchedulerQueueWorker.java:70)
at com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.executeNextJob(SchedulerQueueWorker.java:59)
at com.atlassian.scheduler.caesium.impl.SchedulerQueueWorker.run(SchedulerQueueWorker.java:34)
at java.lang.Thread.run(Thread.java:745)
jenkins-infra-bot commented 2 years ago

[Originally related to: INFRA-1178]