oom issues with openshift/jenkins-2-centos7 on github

[spicysomtam]

Latest image on docker built 9 days ago. I gave my pod 32Gb of memory and was still getting oom issue. Set it up to use the x86_64 jenkins. Even bumped the CONTAINER_HEAP_PERCENT to 0.80 (80%). The command line for jenkins as follows:

java -XX:+UseParallelGC -XX:MinHeapFreeRatio=20 -XX:MaxHeapFreeRatio=40 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -XX:MaxMetaspaceSize=100m -Xms26214m -Xmx26214m -Duser.home=/var/lib/jenkins -Djavamelody.application-name=JENKINS -Dfile.encoding=UTF8 -jar /usr/lib/jenkins/jenkins.war

If I set it to this, I don't get any oom errors:

/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.151-1.b12.el7_4.x86_64/jre/bin/java -Duser.home=/var/lib/jenkins -Djavamelody.application-name=JENKINS -Dfile.encoding=UTF8 -jar /usr/lib/jenkins/jenkins.war

In essence, I removed all the memory tuning settings, and it behaves. I compared the openshift image against the standard centos jenkins install on a vm, and see that has no memory tuning limits.

I also wonder why you default to a 32bit Jenkins when everyone else has moved over to 64bit?

[spicysomtam]

I had to set JAVA_GC_OPTS=' ' (note space) to disable all the memory settings, apart from the Xms and Xmx. Why is Xms set to be the same as Xmx? Would it not be more sensible to set Xms to say 256Mb?

I also set CONTAINER_HEAP_PERCENT=0.70 (70%) and set parameter MEMORY_LIMIT=8Gi. Anything less than these settings are probably starving Jenkins of memory. OPENSHIFT_JENKINS_JVM_ARCH=x86_64. Hopefully this will help someone.

Some mem info from proc:

$ cat /proc/1/status                                                                                                                                                                                    
Name:   java
VmPeak: 20377480 kB
VmSize: 20273956 kB
VmLck:         0 kB
VmPin:         0 kB
VmHWM:   2452216 kB
VmRSS:   2448568 kB

[bparees]

I also wonder why you default to a 32bit Jenkins when everyone else has moved over to 64bit?

32 bit is more efficient memory-wise if you have a max heap size that fits in a 32bit space.

I gave my pod 32Gb of memory and was still getting oom issue.

do you have the exact OOM message? There are different memory spaces and we need to know what you were actually exhausting.

Why is Xms set to be the same as Xmx?

it avoids forcing the JVM to repeatedly grow the heap, so it's more performant, however we are investigating changing that setting[1]

OPENSHIFT_JENKINS_JVM_ARCH=x86_64.

you should not need to set this. If you're giving jenkins 8gigs of heap, then the startup scripts should automatically use 64bit.

[1] Also we are tuning the settings here, if you're interested in trying the new settings we'd certainly appreciate your feedback: https://github.com/openshift/jenkins/pull/396

[spicysomtam]

I'll do some testing on this next week and get back to you.

But ideally Xms should be a memory small starting point and not the same as the max value! You could even set it really small like 64Mb if you are concerned about low memory environments; for higher usage cases it would just grow upwards anyway.

But for Jenkins we want stability, and thus its not wise to starve it of memory. Its a java jvm app and, well Java apps need memory. As well as running Jenkins, and all the plugins users may want, you need to have memory to run the agent side processing too for jobs. Thus it does need memory. Anything less than 4Gb would probably be problematic and unstable. Only someone running testing in origin would want a very low memory setup.

We have an openshift cluster per datacenter, and are intending to have a jenkins setup per cluster to run jobs on different projects in each cluster. Typically its the same app stack, but difference instances of it (eg qa/prod). You will be able to run a pipeline, select a project from a parameter choice drop down, and then the job will run against that project on the jenkins server; since this is mostly openshift api calls via the oc command, the overhead is quite low on the Jenkins server. Jenkins checks out the code from git, selects the required Jenkinsfile, and then runs the pipeline from that. Jenkinsfiles are grouped per datacenter, so we can customise the config per datacenter.

[bparees]

But ideally Xms should be a memory small starting point and not the same as the max value!

I appreciate your perspective, but plenty of tuning guides recommend setting min==max to avoid performance hiccups caused when the JVM goes to grow the heap and perform compaction. Regardless, we are undoing that setting as part of the PR I referenced.

. As well as running Jenkins, and all the plugins users may want, you need to have memory to run the agent side processing too for jobs. Thus it does need memory. Anything less than 4Gb would probably be problematic and unstable. Only someone running testing in origin would want a very low memory setup.

Different users will have different requirements depending on what plugins they use, whether they run jobs on the master or on slaves, how many jobs they run concurrently, etc. Hence why we make the settings tunable, because we know we are not going to be able to choose the one size fits all values for every possible consumer. So again, while I appreciate your specific concerns, and acknowledge that our default settings are still a work in progress, please recognize that your usage does not necessarily represent all use cases of the image and it's unlikely that our out of the box settings are going to exactly match your ideal settings. Our goal is more to ensure that you can configure the settings that you need, than to expect that our default settings will be exactly what you need.

[spicysomtam]

Sorry did not manage to work on this yesterday.

I have now integrated the jenkins setup into my origin startup (3.6), and have reproduced the memory errors. I did not set anything up on Jenkins, and see the issue when I run the build for the built in sample job. I sized the pod to use 8Gb of memory and to use 70% of that for Jenkins.

If a repeat and set env JAVA_GC_OPTS to a space, then no oom errors (the job does not work, but that is because it is misconfigured; at least it runs and fails, which I would expect).

Some logging for you:

64 bit Java explicitly set in OPENSHIFT_JENKINS_JVM_ARCH
Generating kubernetes-plugin configuration (/opt/openshift/configuration/config.xml.tpl) ...
Copying Jenkins configuration to /var/lib/jenkins ...
Installing additional plugins: ansicolor:0.5.2 ...
Creating initial locks...
Locking ansicolor:0.5.2

Analyzing war...

Downloading plugins...
Downloading plugin: ansicolor from https://updates.jenkins-ci.org/download/plugins/ansicolor/0.5.2/ansicolor.hpi
 > ansicolor depends on workflow-step-api:2.12;resolution:=optional
Examining optional dependency workflow-step-api
Optional dependency workflow-step-api already installed, need to determine if it is at a sufficient version
Upgrading previously downloaded plugin workflow-step-api at 2.10 to 2.12
Downloading plugin: workflow-step-api from https://updates.jenkins-ci.org/download/plugins/workflow-step-api/2.12/workflow-step-api.hpi
 > workflow-step-api depends on structs:1.5

WAR bundled plugins:

Installed plugins:
ace-editor:1.0.1
ansicolor:0.5.2
authentication-tokens:1.1
blueocean-autofavorite:1.0.0
blueocean-commons:1.1.6
blueocean-config:1.1.6
blueocean-dashboard:1.1.6
blueocean-display-url:2.0
blueocean-events:1.1.6
blueocean-github-pipeline:1.1.6
blueocean-git-pipeline:1.1.6
blueocean-i18n:1.1.6
blueocean:1.1.6
blueocean-jwt:1.1.6
blueocean-personalization:1.1.6
blueocean-pipeline-api-impl:1.1.6
blueocean-pipeline-editor:0.2.0
blueocean-pipeline-scm-api:1.1.6
blueocean-rest-impl:1.1.6
blueocean-rest:1.1.6
blueocean-web:1.1.6
branch-api:2.0.9
cloudbees-folder:6.0.4
conditional-buildstep:1.3.1
config-file-provider:2.16.2
credentials-binding:1.12
credentials:2.1.13
display-url-api:2.0
docker-commons:1.8
docker-workflow:1.9
durable-task:1.13
favorite:2.3.0
git-client:2.4.4
github-api:1.85.1
github-branch-source:2.0.8
github:1.26.0
github-organization-folder:1.6
git:3.3.2
git-server:1.5
handlebars:1.1
icon-shim:2.0.3
jackson2-api:2.7.3
job-dsl:1.60
jquery-detached:1.2.1
junit:1.20
kubernetes:1.0
mailer:1.20
mapdb-api:1.0.1.0
matrix-auth:1.5
matrix-project:1.7.1
mercurial:1.54
metrics:3.1.2.9
momentjs:1.1
multiple-scms:0.6
openshift-client:1.0.1
openshift-login:0.12
openshift-pipeline:1.0.52
openshift-sync:0.1.32
parameterized-trigger:2.35.1
pipeline-build-step:2.5.1
pipeline-github-lib:1.0
pipeline-graph-analysis:1.3
pipeline-input-step:2.8
pipeline-milestone-step:1.3
pipeline-model-api:1.1.4
pipeline-model-declarative-agent:1.1.1
pipeline-model-definition:1.1.4
pipeline-model-extensions:1.1.4
pipeline-rest-api:2.9
pipeline-stage-step:2.2
pipeline-stage-tags-metadata:1.1.4
pipeline-stage-view:2.4
pipeline-utility-steps:1.1.5
plain-credentials:1.3
pubsub-light:1.8
run-condition:0.10
scm-api:2.1.1
script-security:1.31
sse-gateway:1.15
ssh-credentials:1.13
structs:1.7
subversion:2.9
token-macro:2.0
variant:1.1
workflow-aggregator:2.5
workflow-api:2.18
workflow-basic-steps:2.3
workflow-cps-global-lib:2.7
workflow-cps:2.39
workflow-durable-task-step:2.11
workflow-job:2.10
workflow-multibranch:2.14
workflow-remote-loader:1.2
workflow-scm-step:2.4
workflow-step-api:2.12
workflow-support:2.14

Cleaning up locks
Copying 96 Jenkins plugins to /var/lib/jenkins ...
Creating initial Jenkins 'admin' user ...
Running from: /usr/lib/jenkins/jenkins.war
webroot: EnvVars.masterEnvVars.get("JENKINS_HOME")
Nov 07, 2017 9:39:34 AM Main deleteWinstoneTempContents
WARNING: Failed to delete the temporary Winstone file /tmp/winstone/jenkins.war
Nov 07, 2017 9:39:34 AM org.eclipse.jetty.util.log.Log initialized
INFO: Logging initialized @316ms to org.eclipse.jetty.util.log.JavaUtilLog
Nov 07, 2017 9:39:34 AM winstone.Logger logInternal
INFO: Beginning extraction from war file
Nov 07, 2017 9:39:35 AM org.eclipse.jetty.server.handler.ContextHandler setContextPath
WARNING: Empty contextPath
Nov 07, 2017 9:39:35 AM org.eclipse.jetty.server.Server doStart
INFO: jetty-9.4.z-SNAPSHOT
Nov 07, 2017 9:39:35 AM org.eclipse.jetty.webapp.StandardDescriptorProcessor visitServlet
INFO: NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
Nov 07, 2017 9:39:35 AM org.eclipse.jetty.server.session.DefaultSessionIdManager doStart
INFO: DefaultSessionIdManager workerName=node0
Nov 07, 2017 9:39:35 AM org.eclipse.jetty.server.session.DefaultSessionIdManager doStart
INFO: No SessionScavenger set, using defaults
Nov 07, 2017 9:39:35 AM org.eclipse.jetty.server.session.HouseKeeper startScavenging
INFO: Scavenging every 660000ms
Jenkins home directory: /var/lib/jenkins found at: EnvVars.masterEnvVars.get("JENKINS_HOME")
Nov 07, 2017 9:39:36 AM org.eclipse.jetty.server.handler.ContextHandler doStart
INFO: Started w.@19fe4644{/,file:///var/lib/jenkins/war/,AVAILABLE}{/var/lib/jenkins/war}
Nov 07, 2017 9:39:36 AM org.eclipse.jetty.server.AbstractConnector doStart
INFO: Started ServerConnector@64beebb7{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}
Nov 07, 2017 9:39:36 AM org.eclipse.jetty.server.Server doStart
INFO: Started @2212ms
Nov 07, 2017 9:39:36 AM winstone.Logger logInternal
INFO: Winstone Servlet Engine v4.0 running: controlPort=disabled
Nov 07, 2017 9:39:36 AM jenkins.InitReactorRunner$1 onAttained
INFO: Started initialization
Nov 07, 2017 9:39:37 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/lib/jenkins/plugins/job-dsl/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Nov 07, 2017 9:39:37 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/lib/jenkins/plugins/authentication-tokens/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Nov 07, 2017 9:39:37 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/lib/jenkins/plugins/mapdb-api/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Nov 07, 2017 9:39:38 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/lib/jenkins/plugins/conditional-buildstep/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Nov 07, 2017 9:39:38 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/lib/jenkins/plugins/git-server/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Nov 07, 2017 9:39:39 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/lib/jenkins/plugins/run-condition/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Nov 07, 2017 9:39:39 AM jenkins.InitReactorRunner$1 onAttained
INFO: Listed all plugins
Nov 07, 2017 9:39:39 AM hudson.plugins.ansicolor.PluginImpl start
INFO: AnsiColor: eliminating boring output (https://github.com/jenkinsci/ansicolor-plugin)
Nov 07, 2017 9:39:45 AM jenkins.InitReactorRunner$1 onAttained
INFO: Prepared all plugins
Nov 07, 2017 9:39:45 AM jenkins.InitReactorRunner$1 onAttained
INFO: Started all plugins
Nov 07, 2017 9:39:47 AM jenkins.InitReactorRunner$1 onAttained
INFO: Augmented all extensions
Nov 07, 2017 9:39:47 AM jenkins.InitReactorRunner$1 onAttained
INFO: Loaded all jobs
Nov 07, 2017 9:39:47 AM hudson.model.AsyncPeriodicWork$1 run
INFO: Started Download metadata
Nov 07, 2017 9:39:47 AM hudson.model.AllView migrateLegacyPrimaryAllViewLocalizedName
INFO: JENKINS-38606 detected for AllView in ; renaming view from All to all
Nov 07, 2017 9:39:47 AM jenkins.InitReactorRunner$1 onAttained
INFO: Completed initialization
Nov 07, 2017 9:39:48 AM org.springframework.context.support.AbstractApplicationContext prepareRefresh
INFO: Refreshing org.springframework.web.context.support.StaticWebApplicationContext@162e86c0: display name [Root WebApplicationContext]; startup date [Tue Nov 07 09:39:48 UTC 2017]; root of context hierarchy
Nov 07, 2017 9:39:48 AM org.springframework.context.support.AbstractApplicationContext obtainFreshBeanFactory
INFO: Bean factory for application context [org.springframework.web.context.support.StaticWebApplicationContext@162e86c0]: org.springframework.beans.factory.support.DefaultListableBeanFactory@21956eb9
Nov 07, 2017 9:39:48 AM org.springframework.beans.factory.support.DefaultListableBeanFactory preInstantiateSingletons
INFO: Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@21956eb9: defining beans [authenticationManager]; root of factory hierarchy
Nov 07, 2017 9:39:48 AM org.springframework.context.support.AbstractApplicationContext prepareRefresh
INFO: Refreshing org.springframework.web.context.support.StaticWebApplicationContext@241605cd: display name [Root WebApplicationContext]; startup date [Tue Nov 07 09:39:48 UTC 2017]; root of context hierarchy
Nov 07, 2017 9:39:48 AM org.springframework.context.support.AbstractApplicationContext obtainFreshBeanFactory
INFO: Bean factory for application context [org.springframework.web.context.support.StaticWebApplicationContext@241605cd]: org.springframework.beans.factory.support.DefaultListableBeanFactory@2b268c46
Nov 07, 2017 9:39:48 AM org.springframework.beans.factory.support.DefaultListableBeanFactory preInstantiateSingletons
INFO: Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@2b268c46: defining beans [filter,legacy]; root of factory hierarchy
Nov 07, 2017 9:39:48 AM io.fabric8.jenkins.openshiftsync.GlobalPluginConfiguration$1 doRun
INFO: Waiting for Jenkins to be started
Nov 07, 2017 9:39:48 AM io.fabric8.jenkins.openshiftsync.BuildConfigWatcher start
INFO: Now handling startup build configs!!
Nov 07, 2017 9:39:48 AM io.fabric8.jenkins.openshiftsync.ConfigMapWatcher start
INFO: Now handling startup config maps!!
Nov 07, 2017 9:39:48 AM io.fabric8.jenkins.openshiftsync.ImageStreamWatcher start
INFO: Now handling startup image streams!!
Nov 07, 2017 9:39:48 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:39:48 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:39:48 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:39:48 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:39:48 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftSetOAuth setOauth
INFO: OpenShift OAuth: enable oauth set to true force true lastCheck Thu Jan 01 00:00:00 UTC 1970
Nov 07, 2017 9:39:48 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftSetOAuth setOauth
INFO: OpenShift OAuth: configured security realm on startup: hudson.security.HudsonPrivateSecurityRealm@6bab9547 last check Thu Jan 01 00:00:00 UTC 1970
Nov 07, 2017 9:39:48 AM io.fabric8.jenkins.openshiftsync.ConfigMapWatcher$1 doRun
INFO: creating ConfigMap watch for namespace razcp-origin and resource version 1341
Nov 07, 2017 9:39:48 AM io.fabric8.jenkins.openshiftsync.BuildConfigWatcher$1 doRun
INFO: creating BuildConfig watch for namespace razcp-origin and resource version 1341
Nov 07, 2017 9:39:48 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:39:48 AM io.fabric8.jenkins.openshiftsync.BuildWatcher$1 doRun
INFO: creating Build watch for namespace razcp-origin and resource version 1341
Nov 07, 2017 9:39:48 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:39:49 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:39:49 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftOAuth2SecurityRealm populateDefaults
INFO: OpenShift OAuth: provider: OpenShiftProviderInfo: issuer: https://127.0.0.1:8443 auth ep: https://127.0.0.1:8443/oauth/authorize token ep: https://127.0.0.1:8443/oauth/token
Nov 07, 2017 9:39:49 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftOAuth2SecurityRealm populateDefaults
INFO: OpenShift OAuth returning true with namespace razcp-origin SA dir null default /run/secrets/kubernetes.io/serviceaccount SA name null default jenkins client ID null default system:serviceaccount:razcp-o
rigin:jenkins secret null default eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJyYXpjcC1vcmlnaW4iLCJrdWJlcm5ldGVzL
mlvL3NlcnZpY2VhY2NvdW50L3NlY3JldC5uYW1lIjoiamVua2lucy10b2tlbi1tMzVxYyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJqZW5raW5zIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY
291bnQudWlkIjoiODhiYzdkNjktYzM5Zi0xMWU3LWIyOTMtMDA5MGY1ZWY2YWU0Iiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50OnJhemNwLW9yaWdpbjpqZW5raW5zIn0.gLcRbrq5jcoO1QoIe9IrcJVQYkhXgMfO7rpTAeLh3v2tvmvikLliJEabj5JJ6NfhgG_NwaLN4
MO1Mee_K6Kxn2T-QY7FGP7AsvjkeZ_2qlDrXYRLumAWBAfw7DjoEfrhVZyhlz9FQVKDGi_XiBZ8HQcwjf8Qz-PFuHF_bxKEKqX6akhMeJxFJIySMO5EtdXNm_SMZlBphgoZ7SCjy4GNStqbKc9ZZ4wRNbbBr8cr3abOkXQ-IdIWJJa4qc9iQpntM4DyX3GLpGuhVVEm_qTDkxQI9
IznJ-1n2Qu1Q_irRQNeBDVAOMO-95RR-wQh9Tuc4Kb6ORndmdYoHz3buEvEFw redirect null default https://127.0.0.1:8443 server null default https://openshift.default.svc
Nov 07, 2017 9:39:49 AM io.fabric8.jenkins.openshiftsync.ImageStreamWatcher$1 doRun
INFO: creating ImageStream watch for namespace razcp-origin and resource version 1341
Nov 07, 2017 9:39:49 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftOAuth2SecurityRealm populateDefaults
INFO: OpenShift OAuth: provider: OpenShiftProviderInfo: issuer: https://127.0.0.1:8443 auth ep: https://127.0.0.1:8443/oauth/authorize token ep: https://127.0.0.1:8443/oauth/token
Nov 07, 2017 9:39:49 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftOAuth2SecurityRealm populateDefaults
INFO: OpenShift OAuth returning true with namespace razcp-origin SA dir null default /run/secrets/kubernetes.io/serviceaccount SA name null default jenkins client ID null default system:serviceaccount:razcp-o
rigin:jenkins secret null default eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJyYXpjcC1vcmlnaW4iLCJrdWJlcm5ldGVzL
mlvL3NlcnZpY2VhY2NvdW50L3NlY3JldC5uYW1lIjoiamVua2lucy10b2tlbi1tMzVxYyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJqZW5raW5zIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY
291bnQudWlkIjoiODhiYzdkNjktYzM5Zi0xMWU3LWIyOTMtMDA5MGY1ZWY2YWU0Iiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50OnJhemNwLW9yaWdpbjpqZW5raW5zIn0.gLcRbrq5jcoO1QoIe9IrcJVQYkhXgMfO7rpTAeLh3v2tvmvikLliJEabj5JJ6NfhgG_NwaLN4
MO1Mee_K6Kxn2T-QY7FGP7AsvjkeZ_2qlDrXYRLumAWBAfw7DjoEfrhVZyhlz9FQVKDGi_XiBZ8HQcwjf8Qz-PFuHF_bxKEKqX6akhMeJxFJIySMO5EtdXNm_SMZlBphgoZ7SCjy4GNStqbKc9ZZ4wRNbbBr8cr3abOkXQ-IdIWJJa4qc9iQpntM4DyX3GLpGuhVVEm_qTDkxQI9
IznJ-1n2Qu1Q_irRQNeBDVAOMO-95RR-wQh9Tuc4Kb6ORndmdYoHz3buEvEFw redirect null default https://127.0.0.1:8443 server null default https://openshift.default.svc
Nov 07, 2017 9:39:49 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftSetOAuth setOauth
INFO: OpenShift OAuth: running in OpenShift pod with required OAuth features: true
Nov 07, 2017 9:39:49 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:39:49 AM org.springframework.context.support.AbstractApplicationContext prepareRefresh
INFO: Refreshing org.springframework.web.context.support.StaticWebApplicationContext@486008b: display name [Root WebApplicationContext]; startup date [Tue Nov 07 09:39:49 UTC 2017]; root of context hierarchy
Nov 07, 2017 9:39:49 AM org.springframework.context.support.AbstractApplicationContext obtainFreshBeanFactory
INFO: Bean factory for application context [org.springframework.web.context.support.StaticWebApplicationContext@486008b]: org.springframework.beans.factory.support.DefaultListableBeanFactory@3508b575
Nov 07, 2017 9:39:49 AM org.springframework.beans.factory.support.DefaultListableBeanFactory preInstantiateSingletons
INFO: Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@3508b575: defining beans [filter,legacy]; root of factory hierarchy
Nov 07, 2017 9:39:49 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftSetOAuth setOauth
INFO: OpenShift OAuth: Jenkins security realm set to OpenShift OAuth
Nov 07, 2017 9:39:49 AM hudson.WebAppMain$3 run
INFO: Jenkins is fully up and running
Nov 07, 2017 9:39:54 AM hudson.model.UpdateSite updateData
INFO: Obtained the latest update center data file for UpdateSource default
Nov 07, 2017 9:39:54 AM hudson.model.DownloadService$Downloadable load
INFO: Obtained the updated data file for hudson.tasks.Maven.MavenInstaller
Nov 07, 2017 9:39:57 AM hudson.model.DownloadService$Downloadable load
INFO: Obtained the updated data file for hudson.tools.JDKInstaller
Nov 07, 2017 9:39:57 AM hudson.model.AsyncPeriodicWork$1 run
INFO: Finished Download metadata. 9,392 ms
Nov 07, 2017 9:42:33 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftOAuth2SecurityRealm populateDefaults
INFO: OpenShift OAuth: provider: OpenShiftProviderInfo: issuer: https://127.0.0.1:8443 auth ep: https://127.0.0.1:8443/oauth/authorize token ep: https://127.0.0.1:8443/oauth/token
Nov 07, 2017 9:42:33 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftOAuth2SecurityRealm populateDefaults
INFO: OpenShift OAuth returning true with namespace razcp-origin SA dir null default /run/secrets/kubernetes.io/serviceaccount SA name null default jenkins client ID null default system:serviceaccount:razcp-o
rigin:jenkins secret null default eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJyYXpjcC1vcmlnaW4iLCJrdWJlcm5ldGVzL
mlvL3NlcnZpY2VhY2NvdW50L3NlY3JldC5uYW1lIjoiamVua2lucy10b2tlbi1tMzVxYyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJqZW5raW5zIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY
291bnQudWlkIjoiODhiYzdkNjktYzM5Zi0xMWU3LWIyOTMtMDA5MGY1ZWY2YWU0Iiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50OnJhemNwLW9yaWdpbjpqZW5raW5zIn0.gLcRbrq5jcoO1QoIe9IrcJVQYkhXgMfO7rpTAeLh3v2tvmvikLliJEabj5JJ6NfhgG_NwaLN4
MO1Mee_K6Kxn2T-QY7FGP7AsvjkeZ_2qlDrXYRLumAWBAfw7DjoEfrhVZyhlz9FQVKDGi_XiBZ8HQcwjf8Qz-PFuHF_bxKEKqX6akhMeJxFJIySMO5EtdXNm_SMZlBphgoZ7SCjy4GNStqbKc9ZZ4wRNbbBr8cr3abOkXQ-IdIWJJa4qc9iQpntM4DyX3GLpGuhVVEm_qTDkxQI9
IznJ-1n2Qu1Q_irRQNeBDVAOMO-95RR-wQh9Tuc4Kb6ORndmdYoHz3buEvEFw redirect null default https://127.0.0.1:8443 server null default https://openshift.default.svc
Nov 07, 2017 9:42:41 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftOAuth2SecurityRealm populateDefaults
INFO: OpenShift OAuth: provider: OpenShiftProviderInfo: issuer: https://127.0.0.1:8443 auth ep: https://127.0.0.1:8443/oauth/authorize token ep: https://127.0.0.1:8443/oauth/token
Nov 07, 2017 9:42:41 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftOAuth2SecurityRealm populateDefaults
INFO: OpenShift OAuth returning true with namespace razcp-origin SA dir null default /run/secrets/kubernetes.io/serviceaccount SA name null default jenkins client ID null default system:serviceaccount:razcp-o
rigin:jenkins secret null default eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJyYXpjcC1vcmlnaW4iLCJrdWJlcm5ldGVzL
mlvL3NlcnZpY2VhY2NvdW50L3NlY3JldC5uYW1lIjoiamVua2lucy10b2tlbi1tMzVxYyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJqZW5raW5zIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY
291bnQudWlkIjoiODhiYzdkNjktYzM5Zi0xMWU3LWIyOTMtMDA5MGY1ZWY2YWU0Iiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50OnJhemNwLW9yaWdpbjpqZW5raW5zIn0.gLcRbrq5jcoO1QoIe9IrcJVQYkhXgMfO7rpTAeLh3v2tvmvikLliJEabj5JJ6NfhgG_NwaLN4
MO1Mee_K6Kxn2T-QY7FGP7AsvjkeZ_2qlDrXYRLumAWBAfw7DjoEfrhVZyhlz9FQVKDGi_XiBZ8HQcwjf8Qz-PFuHF_bxKEKqX6akhMeJxFJIySMO5EtdXNm_SMZlBphgoZ7SCjy4GNStqbKc9ZZ4wRNbbBr8cr3abOkXQ-IdIWJJa4qc9iQpntM4DyX3GLpGuhVVEm_qTDkxQI9
IznJ-1n2Qu1Q_irRQNeBDVAOMO-95RR-wQh9Tuc4Kb6ORndmdYoHz3buEvEFw redirect null default https://127.0.0.1:8443 server null default https://openshift.default.svc
Nov 07, 2017 9:42:41 AM org.openshift.jenkins.plugins.openshiftlogin.OpenShiftOAuth2SecurityRealm updateAuthorizationStrategy
INFO: OpenShift OAuth: adding permissions for user developer, stored in the matrix as developer-admin, based on OpenShift roles [view, edit, admin]
log4j:ERROR A "org.apache.log4j.ConsoleAppender" object is not assignable to a "org.apache.log4j.Appender" variable.
log4j:ERROR The class "org.apache.log4j.Appender" was loaded by 
log4j:ERROR [AntClassLoader[/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/okio-1.8.0.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/commons-compress-1.8.1.jar:/var/lib/jenkins/plugins/o
penshift-pipeline/WEB-INF/lib/commons-codec-1.6.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/jboss-dmr-1.3.0.Final.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/commons-lang-2.6.j
ar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/httpcore-4.2.4.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/jsch-0.1.44-1.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/
openshift-pipeline.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/slf4j-api-1.6.4.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/openshift-restclient-java-5.9.0.Final.jar:/var/lib/je
nkins/plugins/openshift-pipeline/WEB-INF/lib/snakeyaml-1.16.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/slf4j-log4j12-1.6.4.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/findbugs
-annotations-1.3.9-1.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/log4j-1.2.16.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/commons-io-2.1.jar:/var/lib/jenkins/plugins/openshift-
pipeline/WEB-INF/lib/okhttp-3.3.1.jar:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/okhttp-ws-3.3.1.jar]] whereas object of type 
log4j:ERROR "org.apache.log4j.ConsoleAppender" was loaded by [WebAppClassLoader=Jenkins v2.73.2@60bd273d].
log4j:ERROR Could not instantiate appender named "stdout".
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/var/lib/jenkins/plugins/openshift-pipeline/WEB-INF/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/var/lib/jenkins/war/WEB-INF/lib/slf4j-jdk14-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
Nov 07, 2017 9:43:41 AM okhttp3.internal.Platform log
INFO: ALPN callback dropped: SPDY and HTTP/2 are disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:43:41 AM okhttp3.internal.Platform log
INFO: ALPN callback dropped: SPDY and HTTP/2 are disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:43:41 AM okhttp3.internal.Platform log
INFO: ALPN callback dropped: SPDY and HTTP/2 are disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:43:41 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (OkHttp Dispatcher/130) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.OutOfMemoryError: Metaspace
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
    at jenkins.util.AntClassLoader.defineClassFromData(AntClassLoader.java:1140)
    at jenkins.util.AntClassLoader.getClassFromStream(AntClassLoader.java:1311)
    at jenkins.util.AntClassLoader.findClassInComponents(AntClassLoader.java:1364)
    at jenkins.util.AntClassLoader.findClass(AntClassLoader.java:1327)
    at jenkins.util.AntClassLoader.loadClass(AntClassLoader.java:1086)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at okhttp3.internal.http.Http1xStream.getTransferStream(Http1xStream.java:142)
    at okhttp3.internal.http.Http1xStream.openResponseBody(Http1xStream.java:129)
    at okhttp3.internal.http.HttpEngine.readNetworkResponse(HttpEngine.java:784)
    at okhttp3.internal.http.HttpEngine.access$200(HttpEngine.java:86)
    at okhttp3.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:760)
    at com.openshift.restclient.ClientBuilder$1.intercept(ClientBuilder.java:220)
    at okhttp3.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:733)
    at okhttp3.internal.http.HttpEngine.readResponse(HttpEngine.java:613)
    at okhttp3.RealCall.getResponse(RealCall.java:244)
    at okhttp3.RealCall$ApplicationInterceptorChain.proceed(RealCall.java:201)
    at com.openshift.internal.restclient.okhttp.ResponseCodeInterceptor.intercept(ResponseCodeInterceptor.java:54)
    at okhttp3.RealCall$ApplicationInterceptorChain.proceed(RealCall.java:190)
    at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:163)
    at okhttp3.RealCall.access$100(RealCall.java:30)
    at okhttp3.RealCall$AsyncCall.execute(RealCall.java:127)
    at okhttp3.internal.NamedRunnable.run(NamedRunnable.java:32)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)

Nov 07, 2017 9:43:41 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (OkHttp Dispatcher/129) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.OutOfMemoryError: Metaspace
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
    at jenkins.util.AntClassLoader.defineClassFromData(AntClassLoader.java:1140)
    at jenkins.util.AntClassLoader.getClassFromStream(AntClassLoader.java:1311)
    at jenkins.util.AntClassLoader.findClassInComponents(AntClassLoader.java:1364)
    at jenkins.util.AntClassLoader.findClass(AntClassLoader.java:1327)
    at jenkins.util.AntClassLoader.loadClass(AntClassLoader.java:1086)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at okhttp3.internal.http.Http1xStream.getTransferStream(Http1xStream.java:142)
    at okhttp3.internal.http.Http1xStream.openResponseBody(Http1xStream.java:129)
    at okhttp3.internal.http.HttpEngine.readNetworkResponse(HttpEngine.java:784)
    at okhttp3.internal.http.HttpEngine.access$200(HttpEngine.java:86)
    at okhttp3.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:760)
    at com.openshift.restclient.ClientBuilder$1.intercept(ClientBuilder.java:220)
    at okhttp3.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:733)
    at okhttp3.internal.http.HttpEngine.readResponse(HttpEngine.java:613)
    at okhttp3.RealCall.getResponse(RealCall.java:244)
    at okhttp3.RealCall$ApplicationInterceptorChain.proceed(RealCall.java:201)
    at com.openshift.internal.restclient.okhttp.ResponseCodeInterceptor.intercept(ResponseCodeInterceptor.java:54)
    at okhttp3.RealCall$ApplicationInterceptorChain.proceed(RealCall.java:190)
    at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:163)
    at okhttp3.RealCall.access$100(RealCall.java:30)
    at okhttp3.RealCall$AsyncCall.execute(RealCall.java:127)
    at okhttp3.internal.NamedRunnable.run(NamedRunnable.java:32)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)

Nov 07, 2017 9:43:43 AM okhttp3.internal.Platform log
INFO: ALPN callback dropped: SPDY and HTTP/2 are disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:43:43 AM org.eclipse.jetty.server.handler.ContextHandler$Context log
WARNING: Error while serving http://razcp-jenkins.127.0.0.1.nip.io/job/OpenShift%20Sample/buildHistory/ajax
java.lang.reflect.InvocationTargetException
    at org.kohsuke.stapler.Function$MethodFunction.invoke(Function.java:347)
    at org.kohsuke.stapler.Function.bindAndInvoke(Function.java:184)
    at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:117)
    at org.kohsuke.stapler.MetaClass$1.doDispatch(MetaClass.java:129)
    at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58)
    at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:715)
    at org.kohsuke.stapler.Stapler.invoke(Stapler.java:845)
    at org.kohsuke.stapler.MetaClass$10.dispatch(MetaClass.java:374)
    at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:715)
    at org.kohsuke.stapler.Stapler.invoke(Stapler.java:845)
    at org.kohsuke.stapler.MetaClass$5.doDispatch(MetaClass.java:248)
    at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58)
    at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:715)
    at org.kohsuke.stapler.Stapler.invoke(Stapler.java:845)
    at org.kohsuke.stapler.Stapler.invoke(Stapler.java:649)
    at org.kohsuke.stapler.Stapler.service(Stapler.java:238)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
    at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:841)
    at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1650)
    at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:135)
    at org.openshift.jenkins.plugins.openshiftlogin.OpenShiftPermissionFilter.doFilter(OpenShiftPermissionFilter.java:185)
    at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:132)
    at org.jenkinsci.plugins.ssegateway.Endpoint$SSEListenChannelFilter.doFilter(Endpoint.java:225)
    at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:132)
    at io.jenkins.blueocean.ResourceCacheControl.doFilter(ResourceCacheControl.java:134)
    at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:132)
    at io.jenkins.blueocean.auth.jwt.impl.JwtAuthenticationFilter.doFilter(JwtAuthenticationFilter.java:50)
    at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:132)
    at jenkins.metrics.impl.MetricsFilter.doFilter(MetricsFilter.java:125)
    at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:132)
    at hudson.util.PluginServletFilter.doFilter(PluginServletFilter.java:138)
    at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
    at hudson.security.csrf.CrumbFilter.doFilter(CrumbFilter.java:49)
    at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
    at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:84)
    at hudson.security.UnwrapSecurityExceptionFilter.doFilter(UnwrapSecurityExceptionFilter.java:51)
    at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
    at jenkins.security.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:117)
    at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
    at org.acegisecurity.providers.anonymous.AnonymousProcessingFilter.doFilter(AnonymousProcessingFilter.java:125)
    at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
    at org.acegisecurity.ui.rememberme.RememberMeProcessingFilter.doFilter(RememberMeProcessingFilter.java:142)
    at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
    at org.acegisecurity.ui.AbstractProcessingFilter.doFilter(AbstractProcessingFilter.java:271)
    at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
    at jenkins.security.BasicHeaderProcessor.doFilter(BasicHeaderProcessor.java:92)
    at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
    at org.acegisecurity.context.HttpSessionContextIntegrationFilter.doFilter(HttpSessionContextIntegrationFilter.java:249)
    at hudson.security.HttpSessionContextIntegrationFilter2.doFilter(HttpSessionContextIntegrationFilter2.java:67)
    at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
    at hudson.security.ChainedServletFilter.doFilter(ChainedServletFilter.java:90)
    at hudson.security.HudsonFilter.doFilter(HudsonFilter.java:171)
    at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
    at org.kohsuke.stapler.compression.CompressionFilter.doFilter(CompressionFilter.java:49)
    at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
    at hudson.util.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:82)
    at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
    at org.kohsuke.stapler.DiagnosticThreadNameFilter.doFilter(DiagnosticThreadNameFilter.java:30)
    at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
    at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
    at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:190)
    at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
    at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
    at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
    at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
    at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
    at org.eclipse.jetty.server.Server.handle(Server.java:564)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:317)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:110)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
    at org.eclipse.jetty.util.thread.Invocable.invokePreferred(Invocable.java:128)
    at org.eclipse.jetty.util.thread.Invocable$InvocableExecutor.invoke(Invocable.java:222)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:294)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:199)
    at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:43:44 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /job/OpenShift%20Sample/buildHistory/ajax
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:43:44 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /login
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:43:44 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:43:44 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:43:45 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (RequestHandlerThread[#11]/103) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.IllegalArgumentException: Self-suppression not permitted
    at java.lang.Throwable.addSuppressed(Throwable.java:1043)
    at org.eclipse.jetty.server.HttpChannel.minimalErrorResponse(HttpChannel.java:544)
    at org.eclipse.jetty.server.HttpChannel.handleException(HttpChannel.java:529)
    at org.eclipse.jetty.server.HttpChannelOverHttp.handleException(HttpChannelOverHttp.java:463)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:458)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:110)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
    at org.eclipse.jetty.util.thread.Invocable.invokePreferred(Invocable.java:128)
    at org.eclipse.jetty.util.thread.Invocable$InvocableExecutor.invoke(Invocable.java:222)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:294)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:199)
    at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Metaspace
Nov 07, 2017 9:43:45 AM okhttp3.internal.Platform log
INFO: ALPN callback dropped: SPDY and HTTP/2 are disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:43:54 AM okhttp3.internal.Platform log
INFO: ALPN callback dropped: SPDY and HTTP/2 are disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:43:54 AM okhttp3.internal.Platform log
INFO: ALPN callback dropped: SPDY and HTTP/2 are disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:43:55 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /login
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:43:55 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:43:56 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (OkHttp Dispatcher/137) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:43:57 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (RequestHandlerThread[#14]/118) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.IllegalArgumentException: Self-suppression not permitted
    at java.lang.Throwable.addSuppressed(Throwable.java:1043)
    at org.eclipse.jetty.server.HttpChannel.minimalErrorResponse(HttpChannel.java:544)
    at org.eclipse.jetty.server.HttpChannel.handleException(HttpChannel.java:529)
    at org.eclipse.jetty.server.HttpChannelOverHttp.handleException(HttpChannelOverHttp.java:463)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:458)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:110)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
    at org.eclipse.jetty.util.thread.Invocable.invokePreferred(Invocable.java:128)
    at org.eclipse.jetty.util.thread.Invocable$InvocableExecutor.invoke(Invocable.java:222)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:294)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:199)
    at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:43:57 AM hudson.model.listeners.RunListener report
WARNING: RunListener failed
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:43:58 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (OkHttp Dispatcher/136) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:44:24 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /login
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:44:24 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace
Nov 07, 2017 9:44:24 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (RequestHandlerThread[#7]/43) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.IllegalArgumentException: Self-suppression not permitted
    at java.lang.Throwable.addSuppressed(Throwable.java:1043)
    at org.eclipse.jetty.server.HttpChannel.minimalErrorResponse(HttpChannel.java:544)
    at org.eclipse.jetty.server.HttpChannel.handleException(HttpChannel.java:529)
    at org.eclipse.jetty.server.HttpChannelOverHttp.handleException(HttpChannelOverHttp.java:463)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:458)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:110)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
    at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:44:40 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /login
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:44:40 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:44:45 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (RequestHandlerThread[#2]/15) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.IllegalArgumentException: Self-suppression not permitted
    at java.lang.Throwable.addSuppressed(Throwable.java:1043)
    at org.eclipse.jetty.server.HttpChannel.minimalErrorResponse(HttpChannel.java:544)
    at org.eclipse.jetty.server.HttpChannel.handleException(HttpChannel.java:529)
    at org.eclipse.jetty.server.HttpChannelOverHttp.handleException(HttpChannelOverHttp.java:463)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:458)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:110)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
    at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:44:50 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /login
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:07 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:44:46 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /login
java.lang.OutOfMemoryError: Metaspace
Nov 07, 2017 9:45:07 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:11 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (RequestHandlerThread[#23]/148) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.IllegalArgumentException: Self-suppression not permitted
    at java.lang.Throwable.addSuppressed(Throwable.java:1043)
    at org.eclipse.jetty.server.HttpChannel.minimalErrorResponse(HttpChannel.java:544)
    at org.eclipse.jetty.server.HttpChannel.handleException(HttpChannel.java:529)
    at org.eclipse.jetty.server.HttpChannelOverHttp.handleException(HttpChannelOverHttp.java:463)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:458)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:110)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
    at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:13 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (RequestHandlerThread[#16]/120) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.IllegalArgumentException: Self-suppression not permitted
    at java.lang.Throwable.addSuppressed(Throwable.java:1043)
    at org.eclipse.jetty.server.HttpChannel.minimalErrorResponse(HttpChannel.java:544)
    at org.eclipse.jetty.server.HttpChannel.handleException(HttpChannel.java:529)
    at org.eclipse.jetty.server.HttpChannelOverHttp.handleException(HttpChannelOverHttp.java:463)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:458)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:110)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
    at org.eclipse.jetty.util.thread.Invocable.invokePreferred(Invocable.java:128)
    at org.eclipse.jetty.util.thread.Invocable$InvocableExecutor.invoke(Invocable.java:222)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:294)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:199)
    at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:13 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:45:14 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /login
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:15 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:14 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /login
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:17 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:17 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (RequestHandlerThread[#22]/147) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.IllegalArgumentException: Self-suppression not permitted
    at java.lang.Throwable.addSuppressed(Throwable.java:1043)
    at org.eclipse.jetty.server.HttpChannel.minimalErrorResponse(HttpChannel.java:544)
    at org.eclipse.jetty.server.HttpChannel.handleException(HttpChannel.java:529)
    at org.eclipse.jetty.server.HttpChannelOverHttp.handleException(HttpChannelOverHttp.java:463)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:458)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:110)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
    at org.eclipse.jetty.util.thread.Invocable.invokePreferred(Invocable.java:128)
    at org.eclipse.jetty.util.thread.Invocable$InvocableExecutor.invoke(Invocable.java:222)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:294)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:199)
    at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:19 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (RequestHandlerThread[#18]/126) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.
java.lang.IllegalArgumentException: Self-suppression not permitted
    at java.lang.Throwable.addSuppressed(Throwable.java:1043)
    at org.eclipse.jetty.server.HttpChannel.minimalErrorResponse(HttpChannel.java:544)
    at org.eclipse.jetty.server.HttpChannel.handleException(HttpChannel.java:529)
    at org.eclipse.jetty.server.HttpChannelOverHttp.handleException(HttpChannelOverHttp.java:463)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:458)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:110)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
    at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:17 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:45:31 AM okhttp3.internal.platform.Platform log
INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Nov 07, 2017 9:45:26 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /login
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:25 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: /login
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:59 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace

Nov 07, 2017 9:45:59 AM org.eclipse.jetty.server.HttpChannel handleException
WARNING: ERROR dispatch failed
java.lang.OutOfMemoryError: Metaspace

[spicysomtam]

Regarding all the tuning stuff: this is not a database or real time system. Its just Jenkins that run Jenkins jobs so optimal tuning is not required. I think its a good idea to set -Xmx and to size it based on the pod memory available, to specify the pod memory size, and the idea of an env var where you can specify % of memory to give to Jenkins. In our case we don't run any agents so all the processing runs on Jenkins. You are the mercy of Jenkins plugins and have no control over them. I would not set -Xms to be the same as -Xmx for a 8Gb pod, 4Gb would be given to Jenkins and I am of the view that it should be much smaller and be allowed to grow up to what it needs.

[gabemontero]

OK the OOM is definitely are familiar friend, metaspace

https://github.com/openshift/jenkins/pull/396 which @bparees referenced earlier is thought to address this issue, as we are deferring to the JVM to autotune metaspace. See https://github.com/fabric8-services/fabric8-tenant-jenkins/pull/30#issuecomment-336090860 if interested in some of the detailed background.

We currently plan on merging https://github.com/openshift/jenkins/pull/396 once the openshift jenkins images for the openshift 3.7 release are cut (should be later this month).

[bparees]

i've marked https://github.com/openshift/jenkins/pull/396 as fixing this issue, it will close when that PR merges.

[spicysomtam]

Thanks all.

Other than that the image is pretty good, and does what we want out of the box without needing to add any plugins. Its up to date too, Jenkins wise, although need to update loads of the plugins, but hey that is the world of Jenkins!

Might I suggest you tag the image with the Jenkins version on docker hub?