search

jenkinsci / configuration-as-code-plugin

Jenkins Configuration as Code Plugin
https://plugins.jenkins.io/configuration-as-code
MIT License
2.7k stars 723 forks source link

Casc configuration is not loaded correctly at startup #1171

Closed runzexia closed 4 years ago

runzexia commented 5 years ago

ref https://github.com/jenkinsci/configuration-as-code-plugin/issues/1026

Your checklist for this issue

🚨 Please review the guidelines for contributing to this repository.

    - ace-editor:1.1
    - apache-httpcomponents-client-4-api:4.5.5-3.0
    - async-http-client:1.9.40.0
    - authentication-tokens:1.3
    - azure-commons:1.0.3
    - blueocean:1.18.1
    - blueocean-autofavorite:1.2.3
    - blueocean-bitbucket-pipeline:1.18.1
    - blueocean-commons:1.18.1
    - blueocean-config:1.18.1
    - blueocean-core-js:1.18.1
    - blueocean-dashboard:1.18.1
    - blueocean-display-url:2.2.0
    - blueocean-events:1.18.1
    - blueocean-executor-info:1.18.1
    - blueocean-git-pipeline:1.18.1
    - blueocean-github-pipeline:1.18.1
    - blueocean-i18n:1.18.1
    - blueocean-jira:1.18.1
    - blueocean-jwt:1.18.1
    - blueocean-personalization:1.18.1
    - blueocean-pipeline-api-impl:1.18.1
    - blueocean-pipeline-editor:1.18.1
    - blueocean-pipeline-scm-api:1.18.1
    - blueocean-rest-impl:1.18.1
    - blueocean-rest:1.18.1
    - blueocean-web:1.18.1
    - bouncycastle-api:2.17
    - branch-api:2.2.0
    - build-monitor-plugin:1.12+build.201809061734
    - build-timeout:1.19
    - cloudbees-bitbucket-branch-source:2.4.5
    - cloudbees-folder:6.9
    - command-launcher:1.3
    - conditional-buildstep:1.3.6
    - configuration-as-code:1.27
    - configuration-as-code-support:1.18
    - config-file-provider:3.6
    - credentials-binding:1.18
    - credentials:2.3.0
    - display-url-api:2.3.2
    - docker-commons:1.15
    - docker-workflow:1.17
    - durable-task:1.30
    - favorite:2.3.2
    - generic-webhook-trigger:1.45
    - git-client:2.7.6
    - git-server:1.7
    - git:3.9.3
    - github-api:1.95
    - github-branch-source:2.4.2
    - github:1.29.4
    - handlebars:1.1.1
    - handy-uri-templates-2-api:2.1.7-1.0
    - htmlpublisher:1.18
    - jackson2-api:2.9.9.1
    - javadoc:1.5
    - jaxb:2.3.0.1
    - jdk-tool:1.2
    - jenkins-design-language:1.18.1
    - jira:3.0.8
    - job-dsl:1.75
    - jquery:1.11.2-0
    - jquery-detached:1.2.1
    - jquery-ui:1.0.1
    - jsch:0.1.55
    - junit:1.27
    - kubernetes-cd:2.1.2
    - kubernetes-client-api:1.0.0
    - kubernetes-credentials:0.4.0
    - kubernetes:1.19.2
    - kubesphere-extension:0.0.1 (https://github.com/kubesphere/kubesphere-extension-plugin)
    - kubesphere-token-auth:0.2.0 (https://github.com/runzexia/kubesphere-token-auth-plugin)
    - ldap:1.20
    - lockable-resources:2.5
    - mailer:1.24
    - managed-scripts:1.4
    - mapdb-api:1.0.9.0
    - maven-plugin:3.4
    - matrix-auth:2.4.2
    - matrix-project:1.14
    - mercurial:2.4
    - metrics:4.0.2.5
    - momentjs:1.1.1
    - multibranch-action-triggers:1.4
    - node-iterator-api:1.5
    - parameterized-trigger:2.35.2
    - pipeline-build-step:2.8
    - pipeline-graph-analysis:1.10
    - pipeline-input-step:2.10
    - pipeline-milestone-step:1.3.1
    - pipeline-model-api:1.3.9
    - pipeline-model-declarative-agent:1.1.1
    - pipeline-model-definition:1.3.7
    - pipeline-model-extensions:1.3.9
    - pipeline-rest-api:2.10
    - pipeline-stage-step:2.3
    - pipeline-stage-tags-metadata:1.3.7
    - pipeline-stage-view:2.10
    - plain-credentials:1.5
    - pubsub-light:1.12
    - run-condition:1.2
    - resource-disposer:0.12
    - role-strategy:2.13
    - ruby-runtime:0.12
    - scm-api:2.6.3
    - script-security:1.62
    - sonar:2.8.1
    - sse-gateway:1.19
    - ssh-credentials:1.17.1
    - ssh-slaves:1.29.4
    - structs:1.20
    - subversion:2.12.1
    - support-core:2.56
    - token-macro:2.8
    - variant:1.3
    - workflow-aggregator:2.6
    - workflow-api:2.37
    - workflow-basic-steps:2.15
    - workflow-cps-global-lib:2.15
    - workflow-cps:2.73
    - workflow-durable-task-step:2.31
    - workflow-job:2.32
    - workflow-multibranch:2.21
    - workflow-scm-step:2.9
    - workflow-step-api:2.20
    - workflow-support:3.3
    - ws-cleanup:0.37

casc config: https://github.com/kubesphere/ks-installer/blob/master/roles/ks-devops/jenkins/templates/jenkins-casc-config.yml.j2#L12

groovy init script: https://github.com/kubesphere/ks-installer/blob/master/roles/ks-devops/jenkins/templates/custom-values-jenkins.yaml.j2#L187

jenkins logs

Picked up JAVA_TOOL_OPTIONS: -Xms512m -Xmx512m -XX:MaxRAM=2g -Dhudson.slaves.NodeProvisioner.initialDelay=20 -Dhudson.slaves.NodeProvisioner.MARGIN=50 -Dhudson.slaves.NodeProvisioner.MARGIN0=0.85 -Dhudson.model.LoadStatistics.clock=5000 -Dhudson.model.LoadStatistics.decay=0.2 -Dhudson.slaves.NodeProvisioner.recurrencePeriod=5000 -verbose:gc -Xloggc:/var/jenkins_home/gc-%t.log -XX:NumberOfGCLogFiles=2 -XX:+UseGCLogFileRotation -XX:GCLogFileSize=100m -XX:+PrintGC -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintHeapAtGC -XX:+PrintGCCause -XX:+PrintTenuringDistribution -XX:+PrintReferenceGC -XX:+PrintAdaptiveSizePolicy -XX:+UseG1GC -XX:+UseStringDeduplication -XX:+ParallelRefProcEnabled -XX:+DisableExplicitGC -XX:+UnlockDiagnosticVMOptions -XX:+UnlockExperimentalVMOptions
Running from: /usr/share/jenkins/jenkins.war
webroot: EnvVars.masterEnvVars.get("JENKINS_HOME")
Oct 16, 2019 9:40:59 AM org.eclipse.jetty.util.log.Log initialized
INFO: Logging initialized @800ms to org.eclipse.jetty.util.log.JavaUtilLog
Oct 16, 2019 9:40:59 AM winstone.Logger logInternal
INFO: Beginning extraction from war file
Oct 16, 2019 9:41:01 AM org.eclipse.jetty.server.handler.ContextHandler setContextPath
WARNING: Empty contextPath
Oct 16, 2019 9:41:01 AM org.eclipse.jetty.server.Server doStart
INFO: jetty-9.4.z-SNAPSHOT; built: 2019-02-15T16:53:49.381Z; git: eb70b240169fcf1abbd86af36482d1c49826fa0b; jvm 1.8.0_212-b04
Oct 16, 2019 9:41:01 AM org.eclipse.jetty.webapp.StandardDescriptorProcessor visitServlet
INFO: NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
Oct 16, 2019 9:41:01 AM org.eclipse.jetty.server.session.DefaultSessionIdManager doStart
INFO: DefaultSessionIdManager workerName=node0
Oct 16, 2019 9:41:01 AM org.eclipse.jetty.server.session.DefaultSessionIdManager doStart
INFO: No SessionScavenger set, using defaults
Oct 16, 2019 9:41:01 AM org.eclipse.jetty.server.session.HouseKeeper startScavenging
INFO: node0 Scavenging every 600000ms
Jenkins home directory: /var/jenkins_home found at: EnvVars.masterEnvVars.get("JENKINS_HOME")
Oct 16, 2019 9:41:03 AM org.eclipse.jetty.server.handler.ContextHandler doStart
INFO: Started w.@37eeec90{Jenkins v2.176.2,/,file:///var/jenkins_home/war/,AVAILABLE}{/var/jenkins_home/war}
Oct 16, 2019 9:41:04 AM org.eclipse.jetty.server.AbstractConnector doStart
INFO: Started ServerConnector@302fec27{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}
Oct 16, 2019 9:41:04 AM org.eclipse.jetty.server.Server doStart
INFO: Started @5430ms
Oct 16, 2019 9:41:04 AM winstone.Logger logInternal
INFO: Winstone Servlet Engine v4.0 running: controlPort=disabled
Oct 16, 2019 9:41:07 AM jenkins.InitReactorRunner$1 onAttained
INFO: Started initialization
Oct 16, 2019 9:41:12 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/jenkins_home/plugins/jquery/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Oct 16, 2019 9:41:12 AM hudson.PluginManager considerDetachedPlugin
INFO: Loading a detached plugin as a dependency: /var/jenkins_home/plugins/ant.jpi
Oct 16, 2019 9:41:14 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/jenkins_home/plugins/ant/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Oct 16, 2019 9:41:14 AM hudson.PluginManager considerDetachedPlugin
INFO: Loading a detached plugin as a dependency: /var/jenkins_home/plugins/external-monitor-job.jpi
Oct 16, 2019 9:41:14 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/jenkins_home/plugins/external-monitor-job/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Oct 16, 2019 9:41:14 AM hudson.PluginManager considerDetachedPlugin
INFO: Loading a detached plugin as a dependency: /var/jenkins_home/plugins/windows-slaves.jpi
Oct 16, 2019 9:41:14 AM hudson.PluginManager considerDetachedPlugin
INFO: Loading a detached plugin as a dependency: /var/jenkins_home/plugins/antisamy-markup-formatter.jpi
Oct 16, 2019 9:41:14 AM hudson.PluginManager considerDetachedPlugin
INFO: Loading a detached plugin as a dependency: /var/jenkins_home/plugins/pam-auth.jpi
Oct 16, 2019 9:41:14 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/jenkins_home/plugins/pam-auth/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Oct 16, 2019 9:41:16 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/jenkins_home/plugins/node-iterator-api/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Oct 16, 2019 9:41:17 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/jenkins_home/plugins/job-dsl/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Oct 16, 2019 9:41:17 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/jenkins_home/plugins/jquery-ui/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Oct 16, 2019 9:41:17 AM hudson.PluginManager considerDetachedPlugin
INFO: Loading a detached plugin as a dependency: /var/jenkins_home/plugins/cvs.jpi
Oct 16, 2019 9:41:18 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/jenkins_home/plugins/cvs/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Oct 16, 2019 9:41:21 AM hudson.ClassicPluginStrategy createClassJarFromWebInfClasses
WARNING: Created /var/jenkins_home/plugins/ruby-runtime/WEB-INF/lib/classes.jar; update plugin to a version created with a newer harness
Oct 16, 2019 9:41:21 AM jenkins.InitReactorRunner$1 onAttained
INFO: Listed all plugins
Oct 16, 2019 9:41:22 AM ruby.RubyRuntimePlugin start
INFO: Injecting JRuby into XStream
Oct 16, 2019 9:41:50 AM jenkins.InitReactorRunner$1 onAttained
INFO: Prepared all plugins
Oct 16, 2019 9:41:51 AM jenkins.InitReactorRunner$1 onAttained
INFO: Started all plugins
Oct 16, 2019 9:41:54 AM hudson.ExtensionFinder$GuiceFinder$FaultTolerantScope$1 error
INFO: Failed to instantiate optional component hudson.plugins.build_timeout.operations.AbortAndRestartOperation$DescriptorImpl; skipping
Oct 16, 2019 9:41:55 AM jenkins.InitReactorRunner$1 onAttained
INFO: Augmented all extensions
Oct 16, 2019 9:41:59 AM jenkins.model.Jenkins setBuildsAndWorkspacesDir
INFO: Using non default workspaces directories: ${JENKINS_HOME}/workspace/${ITEM_FULLNAME}.
Oct 16, 2019 9:42:00 AM org.springframework.context.support.AbstractApplicationContext prepareRefresh
INFO: Refreshing org.springframework.web.context.support.StaticWebApplicationContext@388b4a32: display name [Root WebApplicationContext]; startup date [Wed Oct 16 09:42:00 UTC 2019]; root of context hierarchy
Oct 16, 2019 9:42:00 AM org.springframework.context.support.AbstractApplicationContext obtainFreshBeanFactory
INFO: Bean factory for application context [org.springframework.web.context.support.StaticWebApplicationContext@388b4a32]: org.springframework.beans.factory.support.DefaultListableBeanFactory@69a306db
Oct 16, 2019 9:42:00 AM org.springframework.beans.factory.support.DefaultListableBeanFactory preInstantiateSingletons
INFO: Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@69a306db: defining beans [ldapUserSearch,authenticationManager,bindAuthenticator,authoritiesPopulator,initialDirContextFactory]; root of factory hierarchy
Oct 16, 2019 9:42:00 AM org.acegisecurity.ldap.DefaultInitialDirContextFactory setProviderUrl
INFO:  URL 'ldap://openldap.kubesphere-system.svc:389/dc=kubesphere,dc=io', root DN is 'dc=kubesphere,dc=io'
Oct 16, 2019 9:42:01 AM org.springframework.context.support.AbstractApplicationContext prepareRefresh
INFO: Refreshing org.springframework.web.context.support.StaticWebApplicationContext@7e458f7b: display name [Root WebApplicationContext]; startup date [Wed Oct 16 09:42:01 UTC 2019]; root of context hierarchy
Oct 16, 2019 9:42:01 AM org.springframework.context.support.AbstractApplicationContext obtainFreshBeanFactory
INFO: Bean factory for application context [org.springframework.web.context.support.StaticWebApplicationContext@7e458f7b]: org.springframework.beans.factory.support.DefaultListableBeanFactory@2e4acaad
Oct 16, 2019 9:42:01 AM org.springframework.beans.factory.support.DefaultListableBeanFactory preInstantiateSingletons
INFO: Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@2e4acaad: defining beans [filter,legacy]; root of factory hierarchy
Oct 16, 2019 9:42:01 AM org.csanchez.jenkins.plugins.kubernetes.KubernetesClientProvider$SaveableListenerImpl onChange
INFO: Invalidating Kubernetes client: kubernetes null
Processing provided DSL script
Oct 16, 2019 9:42:02 AM javaposse.jobdsl.plugin.JenkinsJobManagement createOrUpdateConfig
INFO: createOrUpdateConfig for init-job
Oct 16, 2019 9:42:04 AM jenkins.InitReactorRunner$1 onAttained
INFO: Loaded all jobs
Oct 16, 2019 9:42:04 AM jenkins.util.groovy.GroovyHookScript execute
INFO: Executing /var/jenkins_home/init.groovy.d/initK8sCredentials.groovy
Oct 16, 2019 9:42:04 AM hudson.model.AsyncPeriodicWork$1 run
INFO: Started Download metadata
Oct 16, 2019 9:42:04 AM hudson.util.Retrier start
INFO: Attempt #1 to do the action check updates server
Oct 16, 2019 9:42:04 AM hudson.model.AllView migrateLegacyPrimaryAllViewLocalizedName
INFO: JENKINS-38606 detected for AllView in hudson.model.Hudson@6200d206; renaming view from All to all
Oct 16, 2019 9:42:05 AM org.springframework.context.support.AbstractApplicationContext prepareRefresh
INFO: Refreshing org.springframework.web.context.support.StaticWebApplicationContext@39e36aeb: display name [Root WebApplicationContext]; startup date [Wed Oct 16 09:42:05 UTC 2019]; root of context hierarchy
Oct 16, 2019 9:42:05 AM org.springframework.context.support.AbstractApplicationContext obtainFreshBeanFactory
INFO: Bean factory for application context [org.springframework.web.context.support.StaticWebApplicationContext@39e36aeb]: org.springframework.beans.factory.support.DefaultListableBeanFactory@2fe0afbc
Oct 16, 2019 9:42:05 AM org.springframework.beans.factory.support.DefaultListableBeanFactory preInstantiateSingletons
INFO: Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@2fe0afbc: defining beans [filter,legacy]; root of factory hierarchy
Oct 16, 2019 9:42:05 AM org.csanchez.jenkins.plugins.kubernetes.KubernetesClientProvider$SaveableListenerImpl onChange
INFO: Invalidating Kubernetes client: kubernetes null
Oct 16, 2019 9:42:05 AM org.csanchez.jenkins.plugins.kubernetes.KubernetesClientProvider$SaveableListenerImpl onChange
INFO: Invalidating Kubernetes client: kubernetes null
Oct 16, 2019 9:42:05 AM jenkins.util.groovy.GroovyHookScript execute
INFO: Executing /var/jenkins_home/init.groovy.d/initMailer.groovy
Oct 16, 2019 9:42:06 AM jenkins.util.groovy.GroovyHookScript execute
INFO: Executing /var/jenkins_home/init.groovy.d/initRBAC.groovy
Enabling role based authorisation strategy...
Oct 16, 2019 9:42:07 AM org.csanchez.jenkins.plugins.kubernetes.KubernetesClientProvider$SaveableListenerImpl onChange
INFO: Invalidating Kubernetes client: kubernetes null
Admin role created...OK
Read role created...OK
Saving changes.
Oct 16, 2019 9:42:07 AM org.csanchez.jenkins.plugins.kubernetes.KubernetesClientProvider$SaveableListenerImpl onChange
INFO: Invalidating Kubernetes client: kubernetes null
Oct 16, 2019 9:42:07 AM jenkins.util.groovy.GroovyHookScript execute
INFO: Executing /var/jenkins_home/init.groovy.d/initSonarqube.groovy
--> Configuring SonarRunner
Oct 16, 2019 9:42:08 AM org.csanchez.jenkins.plugins.kubernetes.KubernetesClientProvider$SaveableListenerImpl onChange
INFO: Invalidating Kubernetes client: kubernetes null
Oct 16, 2019 9:42:08 AM jenkins.InitReactorRunner$1 onAttained
INFO: Completed initialization
Oct 16, 2019 9:42:08 AM org.csanchez.jenkins.plugins.kubernetes.KubernetesClientProvider$SaveableListenerImpl onChange
INFO: Invalidating Kubernetes client: kubernetes null
Oct 16, 2019 9:42:08 AM hudson.WebAppMain$3 run
INFO: Jenkins is fully up and running
Oct 16, 2019 9:42:29 AM hudson.model.UpdateSite updateData
INFO: Obtained the latest update center data file for UpdateSource default
Oct 16, 2019 9:42:30 AM hudson.model.DownloadService$Downloadable load
INFO: Obtained the updated data file for hudson.tasks.Maven.MavenInstaller
Oct 16, 2019 9:42:30 AM hudson.model.DownloadService$Downloadable load
INFO: Obtained the updated data file for hudson.plugins.sonar.MsBuildSonarQubeRunnerInstaller
Oct 16, 2019 9:42:31 AM hudson.model.DownloadService$Downloadable load
INFO: Obtained the updated data file for hudson.plugins.sonar.SonarRunnerInstaller
Oct 16, 2019 9:42:31 AM hudson.model.DownloadService$Downloadable load
INFO: Obtained the updated data file for hudson.tasks.Ant.AntInstaller
Oct 16, 2019 9:42:34 AM hudson.model.DownloadService$Downloadable load
INFO: Obtained the updated data file for hudson.tools.JDKInstaller
Oct 16, 2019 9:42:34 AM hudson.util.Retrier start
INFO: Performed the action check updates server successfully at the attempt #1
Oct 16, 2019 9:42:34 AM hudson.model.AsyncPeriodicWork$1 run
INFO: Finished Download metadata. 29,415 ms
Oct 16, 2019 10:22:05 AM org.kohsuke.stapler.LocaleDrivenResourceProvider getLocaleDrivenResourceProviders
INFO: Registered LocaleDrivenResourceProvider: jenkins.MetaLocaleDrivenResourceProvider@6163b875
Oct 16, 2019 11:28:45 AM hudson.model.AsyncPeriodicWork$1 run
INFO: Started Workspace clean-up
Oct 16, 2019 11:28:45 AM hudson.model.AsyncPeriodicWork$1 run
INFO: Finished Workspace clean-up. 6 ms
Oct 16, 2019 7:30:27 PM hudson.model.AsyncPeriodicWork$1 run
INFO: Started Fingerprint cleanup
Oct 16, 2019 7:30:27 PM hudson.model.AsyncPeriodicWork$1 run
INFO: Finished Fingerprint cleanup. 3 ms
Oct 17, 2019 1:57:14 AM hudson.model.AsyncPeriodicWork$1 run
INFO: Started telemetry collection
Oct 17, 2019 1:57:14 AM jenkins.telemetry.Telemetry$TelemetryReporter execute
INFO: Collection of anonymous usage statistics is disabled, skipping telemetry collection and submission
Oct 17, 2019 1:57:14 AM hudson.model.AsyncPeriodicWork$1 run
INFO: Finished telemetry collection. 1 ms

Description

I use the casc and groovy script to initialize jenkins . In the case of the exact same configuration, sometimes casc configuration is not loaded correctly, I confirmed by config.xml

runzexia commented 5 years ago

https://github.com/kubesphere/ks-installer/pull/299/files As a workaround, I load casc again in the groovy hook