openshiftio / openshift.io

Red Hat OpenShift.io is an end-to-end development environment for planning, building and deploying modern applications.
https://openshift.io
97 stars 66 forks source link

Pipeline build failure for new space with rest/SpringBoot example #3058

Closed apupier closed 6 years ago

apupier commented 6 years ago

I followed the "click party" instructions except that i choose Spring Boot instead of the Vert.x

The pipeline build has failed: [ERROR] Failed to execute goal io.fabric8:fabric8-maven-plugin:3.5.38:build (fmp) on project app-test-1: Failed to execute the build: Unable to build the image using the OpenShift build service: An error has occurred. timeout: Socket closed -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal io.fabric8:fabric8-maven-plugin:3.5.38:build (fmp) on project app-test-1: Failed to execute the build

Full log OpenShift Build apupier/arepositoryforclickpartyopenshift.io-1 from https://github.com/apupier/arepositoryforclickpartyopenshift.io.git Connecting to https://api.github.com using apupier/****** (cd-github) Obtained Jenkinsfile from d9fc1c58391b0db9dcbc01f8259844f1ce6e245c Loading library github.com/fabric8io/fabric8-pipeline-library@master Attempting to resolve master from remote references... > git --version # timeout=10 > git ls-remote -h -t https://github.com/fabric8io/fabric8-pipeline-library.git # timeout=10 Found match: refs/heads/master revision 8f9a039c3d1c2962d1a5b874592b7aa277140972 Cloning the remote Git repository Cloning with configured refspecs honoured and without tags Cloning repository https://github.com/fabric8io/fabric8-pipeline-library.git > git init /var/lib/jenkins/jobs/apupier/jobs/arepositoryf.jrspdv.openshift-io/branches/master/workspace@libs/github.com/fabric8io/fabric8-pipeline-library # timeout=10 Fetching upstream changes from https://github.com/fabric8io/fabric8-pipeline-library.git > git --version # timeout=10 > git fetch --no-tags --progress https://github.com/fabric8io/fabric8-pipeline-library.git +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/fabric8io/fabric8-pipeline-library.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/fabric8io/fabric8-pipeline-library.git # timeout=10 Fetching without tags Fetching upstream changes from https://github.com/fabric8io/fabric8-pipeline-library.git > git fetch --no-tags --progress https://github.com/fabric8io/fabric8-pipeline-library.git +refs/heads/*:refs/remotes/origin/* Checking out Revision 8f9a039c3d1c2962d1a5b874592b7aa277140972 (master) > git config core.sparsecheckout # timeout=10 > git checkout -f 8f9a039c3d1c2962d1a5b874592b7aa277140972 Commit message: "Auto format code with Intellij" First time build. Skipping changelog. [Pipeline] echo Loaded PipelineConfiguration PipelineConfiguration{jobNameToKindMap={}, ciBranchPatterns=[PR-.*], cdBranchPatterns=[master], cdGitHostAndOrganisationToBranchPatterns={}, disableITestsCD=false, disableITestsCI=false, useDockerSocketFlag=false} [Pipeline] echo Loaded the useDockerSocket flag false [Pipeline] podTemplate [Pipeline] { [Pipeline] node Still waiting to schedule task Jenkins doesn’t have label mavenarepositoryforclickpartyopenshift.io_1 Running on jenkins-slave-cd022-56b5p in /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA [Pipeline] { [Pipeline] checkout Cloning the remote Git repository Cloning with configured refspecs honoured and without tags Cloning repository https://github.com/apupier/arepositoryforclickpartyopenshift.io.git > git init /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA # timeout=10 Fetching upstream changes from https://github.com/apupier/arepositoryforclickpartyopenshift.io.git > git --version # timeout=10 using GIT_ASKPASS to set credentials cd-github > git fetch --no-tags --progress https://github.com/apupier/arepositoryforclickpartyopenshift.io.git +refs/heads/master:refs/remotes/origin/master > git config remote.origin.url https://github.com/apupier/arepositoryforclickpartyopenshift.io.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/master:refs/remotes/origin/master # timeout=10 > git config remote.origin.url https://github.com/apupier/arepositoryforclickpartyopenshift.io.git # timeout=10 Fetching without tags Fetching upstream changes from https://github.com/apupier/arepositoryforclickpartyopenshift.io.git using GIT_ASKPASS to set credentials cd-github > git fetch --no-tags --progress https://github.com/apupier/arepositoryforclickpartyopenshift.io.git +refs/heads/master:refs/remotes/origin/master Checking out Revision d9fc1c58391b0db9dcbc01f8259844f1ce6e245c (master) > git config core.sparsecheckout # timeout=10 > git checkout -f d9fc1c58391b0db9dcbc01f8259844f1ce6e245c Commit message: "Initial commit" First time build. Skipping changelog. fatal: bad object 8f9a039c3d1c2962d1a5b874592b7aa277140972 [Pipeline] echo Using branch master [Pipeline] echo Using branch master [Pipeline] pwd [Pipeline] load [Pipeline] // load [Pipeline] echo Jenkinsfile.setup.groovy not found [Pipeline] echo NOTE: running pipelines for the first time will take longer as build and base docker images are pulled onto the node [Pipeline] container [Pipeline] { [Pipeline] stage [Pipeline] { (Build Release) [Pipeline] sh [ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA] Running shell script + git checkout -b apupier/arepositoryforclickpartyopenshift.io/master-1.0.1 Switched to a new branch 'apupier/arepositoryforclickpartyopenshift.io/master-1.0.1' [Pipeline] readMavenPom [Pipeline] echo patching maven plugin for spring-boot-booster-parent v1.5.10-15 [Pipeline] writeMavenPom [Pipeline] sh [ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA] Running shell script + mvn org.codehaus.mojo:versions-maven-plugin:2.2:set -U -DnewVersion=1.0.1 Picked up _JAVA_OPTIONS: -Duser.home=/root/ -XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap -Dsun.zip.disableMemoryMapping=true -XX:+UseParallelGC -XX:MinHeapFreeRatio=5 -XX:MaxHeapFreeRatio=10 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -Xms10m -Xmx192m [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Spring Boot - HTTP Booster 1.0.0 [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- versions-maven-plugin:2.2:set (default-cli) @ app-test-1 --- [INFO] Searching for local aggregator root... [INFO] Local aggregation root: /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA [INFO] Processing change of io.openshift.booster:app-test-1:1.0.0 -> 1.0.1 [INFO] Processing io.openshift.booster:app-test-1 [INFO] Updating project io.openshift.booster:app-test-1 [INFO] from version 1.0.0 to 1.0.1 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 19.009 s [INFO] Finished at: 2018-04-12T13:25:10+00:00 [INFO] Final Memory: 10M/15M [INFO] ------------------------------------------------------------------------ [Pipeline] sh [ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA] Running shell script + mvn clean -B -e -U deploy -Dmaven.test.skip=false -P openshift Picked up _JAVA_OPTIONS: -Duser.home=/root/ -XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap -Dsun.zip.disableMemoryMapping=true -XX:+UseParallelGC -XX:MinHeapFreeRatio=5 -XX:MaxHeapFreeRatio=10 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -Xms10m -Xmx192m [INFO] Error stacktraces are turned on. [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Spring Boot - HTTP Booster 1.0.1 [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:3.0.0:clean (default-clean) @ app-test-1 --- [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-java-version) @ app-test-1 --- [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-maven-version) @ app-test-1 --- [INFO] [INFO] --- buildnumber-maven-plugin:1.4:create (get-scm-revision) @ app-test-1 --- [INFO] Executing: /bin/sh -c cd '/home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA' && 'git' 'rev-parse' '--verify' 'HEAD' [INFO] Working directory: /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA [INFO] Storing buildNumber: d9fc1c58391b0db9dcbc01f8259844f1ce6e245c at timestamp: 1523539568030 [INFO] Storing buildScmBranch: apupier/arepositoryforclickpartyopenshift.io/master-1.0.1 [INFO] [INFO] --- maven-resources-plugin:3.0.2:resources (default-resources) @ app-test-1 --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- fabric8-maven-plugin:3.5.38:resource (fmp) @ app-test-1 --- [INFO] F8: Running in OpenShift mode [INFO] F8: Using docker image name of namespace: apupier-jenkins [INFO] F8: Running generator spring-boot [INFO] F8: spring-boot: Using Docker image registry.access.redhat.com/redhat-openjdk-18/openjdk18-openshift:1.2 as base / builder [INFO] F8: using resource templates from /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/src/main/fabric8 [INFO] F8: fmp-controller: Adding a default Deployment [INFO] F8: fmp-service: Adding a default service 'app-test-1' with ports [8080] [INFO] F8: spring-boot-health-check: Adding readiness probe on port 8080, path='/health', scheme='HTTP', with initial delay 10 seconds [INFO] F8: spring-boot-health-check: Adding liveness probe on port 8080, path='/health', scheme='HTTP', with initial delay 180 seconds [INFO] F8: fmp-revision-history: Adding revision history limit to 2 [INFO] F8: f8-icon: Adding icon for deployment [INFO] F8: f8-icon: Adding icon for service [INFO] F8: validating /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/classes/META-INF/fabric8/openshift/app-test-1-svc.yml resource [INFO] F8: validating /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/classes/META-INF/fabric8/openshift/app-test-1-deploymentconfig.yml resource [INFO] F8: validating /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/classes/META-INF/fabric8/openshift/app-test-1-route.yml resource [INFO] F8: validating /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/classes/META-INF/fabric8/kubernetes/app-test-1-svc.yml resource [INFO] F8: validating /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/classes/META-INF/fabric8/kubernetes/app-test-1-deployment.yml resource [INFO] [INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ app-test-1 --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 4 source files to /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/classes [INFO] [INFO] --- maven-resources-plugin:3.0.2:testResources (default-testResources) @ app-test-1 --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @ app-test-1 --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.20:test (default-test) @ app-test-1 --- [INFO] Surefire report directory: /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/surefire-reports [INFO] [INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] Running io.openshift.booster.LocalTest 2018-04-12 13:27:02.680 INFO --- [ main] .b.t.c.SpringBootTestContextBootstrapper : Neither @ContextConfiguration nor @ContextHierarchy found for test class [io.openshift.booster.LocalTest], using SpringBootContextLoader 2018-04-12 13:27:02.689 INFO --- [ main] o.s.t.c.support.AbstractContextLoader : Could not detect default resource locations for test class [io.openshift.booster.LocalTest]: no resource found for suffixes {-context.xml, Context.groovy}. 2018-04-12 13:27:02.690 INFO --- [ main] t.c.s.AnnotationConfigContextLoaderUtils : Could not detect default configuration classes for test class [io.openshift.booster.LocalTest]: LocalTest does not declare any static, non-private, non-final, nested classes annotated with @Configuration. 2018-04-12 13:27:02.987 INFO --- [ main] .b.t.c.SpringBootTestContextBootstrapper : Found @SpringBootConfiguration io.openshift.booster.BoosterApplication for test class io.openshift.booster.LocalTest 2018-04-12 13:27:02.993 INFO --- [ main] .b.t.c.SpringBootTestContextBootstrapper : Loaded default TestExecutionListener class names from location [META-INF/spring.factories]: [org.springframework.boot.test.mock.mockito.MockitoTestExecutionListener, org.springframework.boot.test.mock.mockito.ResetMocksTestExecutionListener, org.springframework.boot.test.autoconfigure.restdocs.RestDocsTestExecutionListener, org.springframework.boot.test.autoconfigure.web.client.MockRestServiceServerResetTestExecutionListener, org.springframework.boot.test.autoconfigure.web.servlet.MockMvcPrintOnlyOnFailureTestExecutionListener, org.springframework.boot.test.autoconfigure.web.servlet.WebDriverTestExecutionListener, org.springframework.test.context.web.ServletTestExecutionListener, org.springframework.test.context.support.DirtiesContextBeforeModesTestExecutionListener, org.springframework.test.context.support.DependencyInjectionTestExecutionListener, org.springframework.test.context.support.DirtiesContextTestExecutionListener, org.springframework.test.context.transaction.TransactionalTestExecutionListener, org.springframework.test.context.jdbc.SqlScriptsTestExecutionListener] 2018-04-12 13:27:03.079 INFO --- [ main] .b.t.c.SpringBootTestContextBootstrapper : Using TestExecutionListeners: [org.springframework.test.context.web.ServletTestExecutionListener@f4ea7c, org.springframework.test.context.support.DirtiesContextBeforeModesTestExecutionListener@16813f3, org.springframework.boot.test.autoconfigure.SpringBootDependencyInjectionTestExecutionListener@fe5c40, org.springframework.test.context.support.DirtiesContextTestExecutionListener@1ebb011, org.springframework.boot.test.mock.mockito.MockitoTestExecutionListener@e31a9a, org.springframework.boot.test.mock.mockito.ResetMocksTestExecutionListener@11774fe, org.springframework.boot.test.autoconfigure.restdocs.RestDocsTestExecutionListener@18d2680, org.springframework.boot.test.autoconfigure.web.client.MockRestServiceServerResetTestExecutionListener@1847718, org.springframework.boot.test.autoconfigure.web.servlet.MockMvcPrintOnlyOnFailureTestExecutionListener@13b84b8, org.springframework.boot.test.autoconfigure.web.servlet.WebDriverTestExecutionListener@1a3af25] . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v1.5.10.RELEASE) 2018-04-12 13:27:04.091 INFO 279 --- [ main] io.openshift.booster.LocalTest : Starting LocalTest on jenkins-slave-cd022-56b5p with PID 279 (started by ? in /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA) 2018-04-12 13:27:04.092 INFO 279 --- [ main] io.openshift.booster.LocalTest : No active profile set, falling back to default profiles: default 2018-04-12 13:27:05.399 INFO 279 --- [ main] ationConfigEmbeddedWebApplicationContext : Refreshing org.springframework.boot.context.embedded.AnnotationConfigEmbeddedWebApplicationContext@8f106e: startup date [Thu Apr 12 13:27:05 UTC 2018]; root of context hierarchy 2018-04-12 13:27:07.892 INFO 279 --- [ main] o.s.b.f.xml.XmlBeanDefinitionReader : Loading XML bean definitions from class path resource [META-INF/cxf/cxf.xml] 2018-04-12 13:27:09.895 INFO 279 --- [ main] f.a.AutowiredAnnotationBeanPostProcessor : JSR-330 'javax.inject.Inject' annotation found and supported for autowiring 2018-04-12 13:27:11.987 INFO 279 --- [ main] s.b.c.e.t.TomcatEmbeddedServletContainer : Tomcat initialized with port(s): 0 (http) 2018-04-12 13:27:12.089 INFO 279 --- [ main] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2018-04-12 13:27:12.090 INFO 279 --- [ main] org.apache.catalina.core.StandardEngine : Starting Servlet Engine: Apache Tomcat/8.5.20 2018-04-12 13:27:12.918 INFO 279 --- [ost-startStop-1] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2018-04-12 13:27:12.919 INFO 279 --- [ost-startStop-1] o.s.web.context.ContextLoader : Root WebApplicationContext: initialization completed in 7524 ms 2018-04-12 13:27:16.207 INFO 279 --- [ost-startStop-1] o.s.b.w.servlet.ServletRegistrationBean : Mapping servlet: 'dispatcherServlet' to [/] 2018-04-12 13:27:16.209 INFO 279 --- [ost-startStop-1] o.s.b.w.servlet.ServletRegistrationBean : Mapping servlet: 'CXFServlet' to [/api/*] 2018-04-12 13:27:16.212 INFO 279 --- [ost-startStop-1] o.s.b.w.servlet.FilterRegistrationBean : Mapping filter: 'metricsFilter' to: [/*] 2018-04-12 13:27:16.213 INFO 279 --- [ost-startStop-1] o.s.b.w.servlet.FilterRegistrationBean : Mapping filter: 'characterEncodingFilter' to: [/*] 2018-04-12 13:27:16.213 INFO 279 --- [ost-startStop-1] o.s.b.w.servlet.FilterRegistrationBean : Mapping filter: 'hiddenHttpMethodFilter' to: [/*] 2018-04-12 13:27:16.213 INFO 279 --- [ost-startStop-1] o.s.b.w.servlet.FilterRegistrationBean : Mapping filter: 'httpPutFormContentFilter' to: [/*] 2018-04-12 13:27:16.213 INFO 279 --- [ost-startStop-1] o.s.b.w.servlet.FilterRegistrationBean : Mapping filter: 'requestContextFilter' to: [/*] 2018-04-12 13:27:16.213 INFO 279 --- [ost-startStop-1] o.s.b.w.servlet.FilterRegistrationBean : Mapping filter: 'webRequestLoggingFilter' to: [/*] 2018-04-12 13:27:16.214 INFO 279 --- [ost-startStop-1] o.s.b.w.servlet.FilterRegistrationBean : Mapping filter: 'applicationContextIdFilter' to: [/*] 2018-04-12 13:27:18.786 INFO 279 --- [ main] s.w.s.m.m.a.RequestMappingHandlerAdapter : Looking for @ControllerAdvice: org.springframework.boot.context.embedded.AnnotationConfigEmbeddedWebApplicationContext@8f106e: startup date [Thu Apr 12 13:27:05 UTC 2018]; root of context hierarchy 2018-04-12 13:27:19.089 INFO 279 --- [ main] s.w.s.m.m.a.RequestMappingHandlerMapping : Mapped "{[/error],produces=[text/html]}" onto public org.springframework.web.servlet.ModelAndView org.springframework.boot.autoconfigure.web.BasicErrorController.errorHtml(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) 2018-04-12 13:27:19.091 INFO 279 --- [ main] s.w.s.m.m.a.RequestMappingHandlerMapping : Mapped "{[/error]}" onto public org.springframework.http.ResponseEntity> org.springframework.boot.autoconfigure.web.BasicErrorController.error(javax.servlet.http.HttpServletRequest) 2018-04-12 13:27:19.299 INFO 279 --- [ main] o.s.w.s.handler.SimpleUrlHandlerMapping : Mapped URL path [/webjars/**] onto handler of type [class org.springframework.web.servlet.resource.ResourceHttpRequestHandler] 2018-04-12 13:27:19.299 INFO 279 --- [ main] o.s.w.s.handler.SimpleUrlHandlerMapping : Mapped URL path [/**] onto handler of type [class org.springframework.web.servlet.resource.ResourceHttpRequestHandler] 2018-04-12 13:27:19.585 INFO 279 --- [ main] o.s.w.s.handler.SimpleUrlHandlerMapping : Mapped URL path [/**/favicon.ico] onto handler of type [class org.springframework.web.servlet.resource.ResourceHttpRequestHandler] 2018-04-12 13:27:19.686 INFO 279 --- [ main] oConfiguration$WelcomePageHandlerMapping : Adding welcome page: class path resource [static/index.html] 2018-04-12 13:27:21.125 INFO 279 --- [ main] org.apache.cxf.endpoint.ServerImpl : Setting the server's publish address to be / 2018-04-12 13:27:22.190 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/trace || /trace.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EndpointMvcAdapter.invoke() 2018-04-12 13:27:22.191 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/info || /info.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EndpointMvcAdapter.invoke() 2018-04-12 13:27:22.191 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/env/{name:.*}],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EnvironmentMvcEndpoint.value(java.lang.String) 2018-04-12 13:27:22.192 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/env || /env.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EndpointMvcAdapter.invoke() 2018-04-12 13:27:22.192 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/metrics/{name:.*}],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.MetricsMvcEndpoint.value(java.lang.String) 2018-04-12 13:27:22.193 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/metrics || /metrics.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EndpointMvcAdapter.invoke() 2018-04-12 13:27:22.194 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/health || /health.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.HealthMvcEndpoint.invoke(javax.servlet.http.HttpServletRequest,java.security.Principal) 2018-04-12 13:27:22.194 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/mappings || /mappings.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EndpointMvcAdapter.invoke() 2018-04-12 13:27:22.197 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/auditevents || /auditevents.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public org.springframework.http.ResponseEntity org.springframework.boot.actuate.endpoint.mvc.AuditEventsMvcEndpoint.findByPrincipalAndAfterAndType(java.lang.String,java.util.Date,java.lang.String) 2018-04-12 13:27:22.197 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/autoconfig || /autoconfig.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EndpointMvcAdapter.invoke() 2018-04-12 13:27:22.199 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/loggers/{name:.*}],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.LoggersMvcEndpoint.get(java.lang.String) 2018-04-12 13:27:22.199 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/loggers/{name:.*}],methods=[POST],consumes=[application/vnd.spring-boot.actuator.v1+json || application/json],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.LoggersMvcEndpoint.set(java.lang.String,java.util.Map) 2018-04-12 13:27:22.199 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/loggers || /loggers.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EndpointMvcAdapter.invoke() 2018-04-12 13:27:22.200 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/dump || /dump.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EndpointMvcAdapter.invoke() 2018-04-12 13:27:22.201 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/beans || /beans.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EndpointMvcAdapter.invoke() 2018-04-12 13:27:22.201 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/heapdump || /heapdump.json],methods=[GET],produces=[application/octet-stream]}" onto public void org.springframework.boot.actuate.endpoint.mvc.HeapdumpMvcEndpoint.invoke(boolean,javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException,javax.servlet.ServletException 2018-04-12 13:27:22.202 INFO 279 --- [ main] o.s.b.a.e.mvc.EndpointHandlerMapping : Mapped "{[/configprops || /configprops.json],methods=[GET],produces=[application/vnd.spring-boot.actuator.v1+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.mvc.EndpointMvcAdapter.invoke() 2018-04-12 13:27:23.789 INFO 279 --- [ main] s.b.c.e.t.TomcatEmbeddedServletContainer : Tomcat started on port(s): 35849 (http) 2018-04-12 13:27:23.796 INFO 279 --- [ main] io.openshift.booster.LocalTest : Started LocalTest in 20.584 seconds (JVM running for 23.5) [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.608 s - in io.openshift.booster.LocalTest 2018-04-12 13:27:31.992 INFO 279 --- [ Thread-4] ationConfigEmbeddedWebApplicationContext : Closing org.springframework.boot.context.embedded.AnnotationConfigEmbeddedWebApplicationContext@8f106e: startup date [Thu Apr 12 13:27:05 UTC 2018]; root of context hierarchy [INFO] [INFO] Results: [INFO] [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] [INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ app-test-1 --- [INFO] Building jar: /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/app-test-1-1.0.1.jar [INFO] [INFO] --- spring-boot-maven-plugin:1.5.10.RELEASE:repackage (default) @ app-test-1 --- [INFO] Attaching archive: /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/app-test-1-1.0.1-exec.jar, with classifier: exec [INFO] [INFO] --- fabric8-maven-plugin:3.5.38:build (fmp) @ app-test-1 --- [INFO] F8: Using OpenShift build with strategy S2I [INFO] F8: Running generator spring-boot [INFO] F8: spring-boot: Using Docker image registry.access.redhat.com/redhat-openjdk-18/openjdk18-openshift:1.2 as base / builder [INFO] Copying files to /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/docker/app-test-1/1.0.1/build/maven [INFO] Building tar: /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/docker/app-test-1/1.0.1/tmp/docker-build.tar [INFO] F8: [app-test-1:1.0.1] "spring-boot": Created docker source tar /home/jenkins/workspace/ickpartyopenshift.io_master-PXY6TETJGQWWR6JPKK6H6WGT6ADLTS3WT6FY7JXTOS677OYJDGQA/target/docker/app-test-1/1.0.1/tmp/docker-build.tar [INFO] F8: Creating BuildServiceConfig app-test-1-s2i for Source build [INFO] F8: Creating ImageStream app-test-1 [INFO] F8: Starting Build app-test-1-s2i EXITCODE 0[ERROR] F8: Failed to execute the build [Unable to build the image using the OpenShift build service] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 07:26 min [INFO] Finished at: 2018-04-12T13:32:42+00:00 [INFO] Final Memory: 42M/66M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal io.fabric8:fabric8-maven-plugin:3.5.38:build (fmp) on project app-test-1: Failed to execute the build: Unable to build the image using the OpenShift build service: An error has occurred. timeout: Socket closed -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal io.fabric8:fabric8-maven-plugin:3.5.38:build (fmp) on project app-test-1: Failed to execute the build at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288) at org.apache.maven.cli.MavenCli.main(MavenCli.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.plugin.MojoExecutionException: Failed to execute the build at io.fabric8.maven.plugin.mojo.build.BuildMojo.buildAndTag(BuildMojo.java:270) at io.fabric8.maven.docker.BuildMojo.executeInternal(BuildMojo.java:44) at io.fabric8.maven.plugin.mojo.build.BuildMojo.executeInternal(BuildMojo.java:228) at io.fabric8.maven.docker.AbstractDockerMojo.execute(AbstractDockerMojo.java:223) at io.fabric8.maven.plugin.mojo.build.BuildMojo.execute(BuildMojo.java:199) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207) ... 20 more Caused by: io.fabric8.maven.core.service.Fabric8ServiceException: Unable to build the image using the OpenShift build service at io.fabric8.maven.core.service.openshift.OpenshiftBuildService.build(OpenshiftBuildService.java:121) at io.fabric8.maven.plugin.mojo.build.BuildMojo.buildAndTag(BuildMojo.java:267) ... 26 more Caused by: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:62) at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:53) at io.fabric8.openshift.client.dsl.internal.BuildConfigOperationsImpl.fromInputStream(BuildConfigOperationsImpl.java:276) at io.fabric8.openshift.client.dsl.internal.BuildConfigOperationsImpl.fromFile(BuildConfigOperationsImpl.java:231) at io.fabric8.openshift.client.dsl.internal.BuildConfigOperationsImpl.fromFile(BuildConfigOperationsImpl.java:68) at io.fabric8.maven.core.service.openshift.OpenshiftBuildService.startBuild(OpenshiftBuildService.java:361) at io.fabric8.maven.core.service.openshift.OpenshiftBuildService.build(OpenshiftBuildService.java:111) ... 27 more Caused by: java.net.SocketTimeoutException: timeout at okio.Okio$4.newTimeoutException(Okio.java:230) at okio.AsyncTimeout.exit(AsyncTimeout.java:285) at okio.AsyncTimeout$2.read(AsyncTimeout.java:241) at okio.RealBufferedSource.indexOf(RealBufferedSource.java:345) at okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:217) at okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:211) at okhttp3.internal.http1.Http1Codec.readResponseHeaders(Http1Codec.java:187) at okhttp3.internal.http.CallServerInterceptor.intercept(CallServerInterceptor.java:61) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:45) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121) at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:93) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121) at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:125) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121) at io.fabric8.openshift.client.internal.OpenShiftOAuthInterceptor.intercept(OpenShiftOAuthInterceptor.java:66) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121) at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:200) at okhttp3.RealCall.execute(RealCall.java:77) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:377) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:359) at io.fabric8.openshift.client.dsl.internal.BuildConfigOperationsImpl.fromInputStream(BuildConfigOperationsImpl.java:274) ... 31 more Caused by: java.net.SocketException: Socket closed at java.net.SocketInputStream.read(SocketInputStream.java:204) at java.net.SocketInputStream.read(SocketInputStream.java:141) at sun.security.ssl.InputRecord.readFully(InputRecord.java:465) at sun.security.ssl.InputRecord.read(InputRecord.java:503) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983) at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:940) at sun.security.ssl.AppInputStream.read(AppInputStream.java:105) at okio.Okio$2.read(Okio.java:139) at okio.AsyncTimeout$2.read(AsyncTimeout.java:237) ... 56 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // container [Pipeline] } [Pipeline] // node [Pipeline] } [Pipeline] // podTemplate [Pipeline] End of Pipeline GitHub has been notified of this commit’s build result ERROR: script returned exit code 1 Finished: FAILURE
apupier commented 6 years ago

please note that clicking "Start pipeline" to try to retrigger a build is not working

apupier commented 6 years ago

when clicking "Start Pipeline", in fact a new pipeline stacks up in OpenSHift console (not visible in openshift.io): image

jaseemabid commented 6 years ago
Failed to execute goal io.fabric8:fabric8-maven-plugin:3.5.38:build (fmp) on project app-test-1: Failed to execute the build: Unable to build the image using the OpenShift build service: An error has occurred. timeout: Socket closed ->

This does not look like a build issue, but a network issue. @aditya-konarde, you might want to take a look at it.

rohanKanojia commented 6 years ago

@apupier: Hi, I'm trying to reproduce this issue. I tried building it several times but somehow I'm not able to reproduce it. Are you able to reproduce it or facing this issue intermittently? Here is what I did:

1) Visit https://openshift.io/_home 2) Select a created space in "Recent spaces" 3) Click "Add to space" in Pipelines. 4) click "import existing code" 5) Select "Spring-boot-http-booster" and click Next. 6) select "Release & stage", and click Next. NOTE: "Override jenkins and POM files" is selected by default. I didn't change it. 7) Just click Finish in the screen including Jenkins space, and so on. 8) Click "OK" 9) Select the running pipelines in Pipelines stage. 10) click "View Log"

Here are my build logs : [:heavy_check_mark:] Build 1: https://pastebin.com/iW550Jpk [:heavy_check_mark:] Build 2: https://pastebin.com/t5F51E6b [:heavy_check_mark:] Build 3: https://pastebin.com/L7ZBEgYM [:heavy_check_mark:] Build 4: https://pastebin.com/bG24YJCV [:heavy_check_mark:] Build 5: https://pastebin.com/TQk8CJAW [:heavy_check_mark:] Build 6: https://pastebin.com/wXqbU2qg [:heavy_check_mark:] Build 7: https://pastebin.com/3BhPzVKC [:heavy_check_mark:] Build 8: https://pastebin.com/50PDWa5b [:heavy_check_mark:] Build 9: https://pastebin.com/375VBWR3 [:x:] Build 10: https://pastebin.com/hPVnjaiK (Exceeded quota error) [:heavy_check_mark:] Build 11: https://pastebin.com/g20CPv5m [:heavy_check_mark:] Build 12: https://pastebin.com/Hj3MfcmK [:heavy_check_mark:] Build 13: https://pastebin.com/zQq7LgDT [:heavy_check_mark:] Build 14: https://pastebin.com/B28n13VL [:heavy_check_mark:] Build 15: https://pastebin.com/MJW2xbT0

rohanKanojia commented 6 years ago

@apupier : At first glance, it doesn't seem like a build issue; as pointed out by Jaseem. The error we get over here in fabric8 maven plugin(i.e Unable to build the image using the OpenShift build service) seems to be coming during the openshift s2i build/watching over the build here:

https://github.com/fabric8io/fabric8-maven-plugin/blob/03ecb4bd630cdd82133ad8916066240aa9055cba/core/src/main/java/io/fabric8/maven/core/service/openshift/OpenshiftBuildService.java#L111

The original exception occurs when watching for a BuildEvent fails. This can have of course several different causes, like a network drop out. (So it doesn't really fails on the logs, but on the watch for the build status). Could you please have a look at all pods, if possible and check whether there is something looking like a build pod? and check the logs?

And while watching over Kubernetes/Openshift resources we open an Okhttp websocket in order to maintain watch. When using watchers, if for any reason the connection is dropped, the client tries to recoonect. Reconnection attempts use exponential back off. You can have a look at the kubernetes-client's code, which is internally used by fabric8-maven-plugin for watch https://github.com/fabric8io/kubernetes-client/blob/d3add2b13cafe6149dd5a6ab49a9224cbfd934cf/kubernetes-client/src/main/java/io/fabric8/kubernetes/client/dsl/internal/WatchConnectionManager.java#L154

Not really sure whether this is related to f-m-p at all. Its hard to reproduce, but what I can do is to simply reattach to the log if this read timeout happens.

apupier commented 6 years ago

I think that this is an intermittent failure as several other people were able to handle it during "click party".

chmouel commented 6 years ago

Related bugzilla https://bugzilla.redhat.com/show_bug.cgi?id=1552373

rohanKanojia commented 6 years ago

After lots of attempts, I'm struggling to reproduce this issue. Maybe this issue comes whenever there are concurrent users using OSIO; Whenever there is a heavy load on the system. See bugzilla ticket shared by @chmouel .Still, I feel that there is not much plugin can do here.

I'm submitting a pull request in fmp for handling this SocketTimeoutException better by checking for possible failures for S2i build like missing ImageStreamTag, unable to reach cluster etc. This could give us a better insight on what caused the failure; rather than just giving an IOException.

pradeepto commented 6 years ago

@animuk @sivaavkd Please see above message.

ldimaggi commented 6 years ago

Is this issue a duplicate of: https://github.com/openshiftio/openshift.io/issues/3178 ?

piyush-garg commented 6 years ago

@ldimaggi seems duplicate

rohanKanojia commented 6 years ago

@ldimaggi : Yes, looks like it's duplicate

ldimaggi commented 6 years ago

Closing as a duplicate of #3178

rohanKanojia commented 6 years ago

No, close #3178

piyush-garg commented 6 years ago

Let this remain open, close #3178

joshuawilson commented 6 years ago

Which team is working this? Please add the team label.

rohanKanojia commented 6 years ago

@pbergene : Could you take a look at this? Seems like a service delivery issue rather than build issue

kbsingh commented 6 years ago

this is a build team scope issue, let us know if you have something concrete by way of what you ned SD to do, and we can prio that - but this is a build team scoped problem at this point.

by way of heavy-load assumption, we've not seen that on the service at this point. if its traffic within a specific namespace, then please check for that using your own accounts and validate.

chmouel commented 6 years ago

@kbsingh would that be concrete enough for you ? https://github.com/openshiftio/openshift.io/issues/2427#issuecomment-373457709

At this point I don't see what else we can do

piyush-garg commented 6 years ago

@maxandersen @krishnapaparaju @pradeepto Can you please take a look at this?

maxandersen commented 6 years ago

possibly related to https://github.com/openshiftio/openshift.io/issues/3299

can any who have this issue do whats suggesting in bugzilla:

Can you curl the pod IP addresses directly?

Can you curl the service while checking tcpdump output?

Can you attach the OVS flows and iptables rules please?

oc adm diagnostics networkcheck
concaf commented 6 years ago

FWIW, facing this too -

screenshot from 2018-05-04 21-58-16

screenshot from 2018-05-04 22-01-47

piyush-garg commented 6 years ago

I faced the same issue today,

Output of some commands mentioned on bugzilla

oc -n pgarg-1-jenkins rsh po/jenkins-3-5c8tj curl -v http://content-repository/
* About to connect() to content-repository port 80 (#0)
*   Trying 172.30.0.33...
* Connected to content-repository (172.30.0.33) port 80 (#0)
> GET / HTTP/1.1
> User-Agent: curl/7.29.0
> Host: content-repository
> Accept: */*
> 
< HTTP/1.1 200 OK
< Content-Type: text/html; charset=utf-8
< Server: Caddy
< Date: Sat, 05 May 2018 11:54:21 GMT
< Transfer-Encoding: chunked
< 
<!DOCTYPE html>
<html>
    <head>
        <title>/</title>
        <meta charset="utf-8">
        <meta name="viewport" content="width=device-width, initial-scale=1.0">
<style>
* { padding: 0; margin: 0; }

body {
    font-family: sans-serif;
    text-rendering: optimizespeed;
}

a {
    color: #006ed3;
    text-decoration: none;
}

a:hover,
h1 a:hover {
    color: #319cff;
}

header,
#summary {
    padding-left: 5%;
    padding-right: 5%;
}

th:first-child,
td:first-child {
    padding-left: 5%;
}

th:last-child,
td:last-child {
    padding-right: 5%;
}

header {
    padding-top: 25px;
    padding-bottom: 15px;
    background-color: #f2f2f2;
}

h1 {
    font-size: 20px;
    font-weight: normal;
    white-space: nowrap;
    overflow-x: hidden;
    text-overflow: ellipsis;
    color: #999;
}

h1 a {
    color: #000;
    margin: 0 4px;
}

h1 a:hover {
    text-decoration: underline;
}

h1 a:first-child {
    margin: 0;
}

main {
    display: block;
}

.meta {
    font-size: 12px;
    font-family: Verdana, sans-serif;
    border-bottom: 1px solid #9C9C9C;
    padding-top: 10px;
    padding-bottom: 10px;
}

.meta-item {
    margin-right: 1em;
}

#filter {
    padding: 4px;
    border: 1px solid #CCC;
}

table {
    width: 100%;
    border-collapse: collapse;
}

tr {
    border-bottom: 1px dashed #dadada;
}

tbody tr:hover {
    background-color: #ffffec;
}

th,
td {
    text-align: left;
    padding: 10px 0;
}

th {
    padding-top: 15px;
    padding-bottom: 15px;
    font-size: 16px;
    white-space: nowrap;
}

th a {
    color: black;
}

th svg {
    vertical-align: middle;
}

td {
    white-space: nowrap;
    font-size: 14px;
}

td:first-child {
    width: 100%;
}

td:nth-child(2) {
    padding: 0 20px 0 20px;
}

th:last-child,
td:last-child {
    text-align: right;
}

td:first-child svg {
    position: absolute;
}

td .name,
td .goup {
    margin-left: 1.75em;
    word-break: break-all;
    overflow-wrap: break-word;
    white-space: pre-wrap;
}

.icon {
    margin-right: 5px;
}

.icon.sort {
    display: inline-block;
    width: 1em;
    height: 1em;
    position: relative;
    top: .2em;
}

.icon.sort .top {
    position: absolute;
    left: 0;
    top: -1px;
}

.icon.sort .bottom {
    position: absolute;
    bottom: -1px;
    left: 0;
}

footer {
    padding: 40px 20px;
    font-size: 12px;
    text-align: center;
}

@media (max-width: 600px) {
    .hideable {
        display: none;
    }

    td:first-child {
        width: auto;
    }

    th:nth-child(2),
    td:nth-child(2) {
        padding-right: 5%;
        text-align: right;
    }

    h1 {
        color: #000;
    }

    h1 a {
        margin: 0;
    }

    #filter {
        max-width: 100px;
    }
}
</style>
    </head>
    <body>
        <svg version="1.1" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" height="0" width="0" style="position: absolute;">
            <defs>
                <!-- Folder -->
                <g id="folder" fill-rule="nonzero" fill="none">
                    <path d="M285.22 37.55h-142.6L110.9 0H31.7C14.25 0 0 16.9 0 37.55v75.1h316.92V75.1c0-20.65-14.26-37.55-31.7-37.55z" fill="#FFA000"/>
                    <path d="M285.22 36H31.7C14.25 36 0 50.28 0 67.74v158.7c0 17.47 14.26 31.75 31.7 31.75H285.2c17.44 0 31.7-14.3 31.7-31.75V67.75c0-17.47-14.26-31.75-31.7-31.75z" fill="#FFCA28"/>
                </g>
                <g id="folder-shortcut" stroke="none" stroke-width="1" fill="none" fill-rule="evenodd">
                    <g id="folder-shortcut-group" fill-rule="nonzero">
                        <g id="folder-shortcut-shape">
                            <path d="M285.224876,37.5486902 L142.612438,37.5486902 L110.920785,0 L31.6916529,0 C14.2612438,0 0,16.8969106 0,37.5486902 L0,112.646071 L316.916529,112.646071 L316.916529,75.0973805 C316.916529,54.4456008 302.655285,37.5486902 285.224876,37.5486902 Z" id="Shape" fill="#FFA000"></path>
                            <path d="M285.224876,36 L31.6916529,36 C14.2612438,36 0,50.2838568 0,67.7419039 L0,226.451424 C0,243.909471 14.2612438,258.193328 31.6916529,258.193328 L285.224876,258.193328 C302.655285,258.193328 316.916529,243.909471 316.916529,226.451424 L316.916529,67.7419039 C316.916529,50.2838568 302.655285,36 285.224876,36 Z" id="Shape" fill="#FFCA28"></path>
                        </g>
                        <path d="M126.154134,250.559184 C126.850974,251.883673 127.300549,253.006122 127.772602,254.106122 C128.469442,255.206122 128.919016,256.104082 129.638335,257.002041 C130.559962,258.326531 131.728855,259 133.100057,259 C134.493737,259 135.415364,258.55102 136.112204,257.67551 C136.809044,257.002041 137.258619,255.902041 137.258619,254.577551 C137.258619,253.904082 137.258619,252.804082 137.033832,251.457143 C136.786566,249.908163 136.561779,249.032653 136.561779,248.583673 C136.089726,242.814286 135.864939,237.920408 135.864939,233.273469 C135.864939,225.057143 136.786566,217.514286 138.180246,210.846939 C139.798713,204.202041 141.889234,198.634694 144.429328,193.763265 C147.216689,188.869388 150.678411,184.873469 154.836973,181.326531 C158.995535,177.779592 163.626149,174.883673 168.481552,172.661224 C173.336954,170.438776 179.113983,168.665306 185.587852,167.340816 C192.061722,166.218367 198.760378,165.342857 205.481514,164.669388 C212.18017,164.220408 219.598146,163.995918 228.162535,163.995918 L246.055591,163.995918 L246.055591,195.514286 C246.055591,197.736735 246.752431,199.510204 248.370899,201.059184 C250.214153,202.608163 252.079886,203.506122 254.372715,203.506122 C256.463236,203.506122 258.531277,202.608163 260.172223,201.059184 L326.102289,137.797959 C327.720757,136.24898 328.642384,134.47551 328.642384,132.253061 C328.642384,130.030612 327.720757,128.257143 326.102289,126.708163 L260.172223,63.4469388 C258.553756,61.8979592 256.463236,61 254.395194,61 C252.079886,61 250.236632,61.8979592 248.393377,63.4469388 C246.77491,64.9959184 246.07807,66.7693878 246.07807,68.9918367 L246.07807,100.510204 L228.162535,100.510204 C166.863084,100.510204 129.166282,117.167347 115.274437,150.459184 C110.666301,161.54898 108.350993,175.310204 108.350993,191.742857 C108.350993,205.279592 113.903236,223.912245 124.760454,247.438776 C125.00772,248.112245 125.457294,249.010204 126.154134,250.559184 Z" id="Shape" fill="#FFFFFF" transform="translate(218.496689, 160.000000) scale(-1, 1) translate(-218.496689, -160.000000) "></path>
                    </g>
                </g>

                <!-- File -->
                <g id="file" stroke="#000" stroke-width="25" fill="#FFF" fill-rule="evenodd" stroke-linecap="round" stroke-linejoin="round">
                    <path d="M13 24.12v274.76c0 6.16 5.87 11.12 13.17 11.12H239c7.3 0 13.17-4.96 13.17-11.12V136.15S132.6 13 128.37 13H26.17C18.87 13 13 17.96 13 24.12z"/>
                    <path d="M129.37 13L129 113.9c0 10.58 7.26 19.1 16.27 19.1H249L129.37 13z"/>
                </g>
                <g id="file-shortcut" stroke="none" stroke-width="1" fill="none" fill-rule="evenodd">
                    <g id="file-shortcut-group" transform="translate(13.000000, 13.000000)">
                        <g id="file-shortcut-shape" stroke="#000000" stroke-width="25" fill="#FFFFFF" stroke-linecap="round" stroke-linejoin="round">
                            <path d="M0,11.1214886 L0,285.878477 C0,292.039924 5.87498876,296.999983 13.1728373,296.999983 L225.997983,296.999983 C233.295974,296.999983 239.17082,292.039942 239.17082,285.878477 L239.17082,123.145388 C239.17082,123.145388 119.58541,2.84217094e-14 115.369423,2.84217094e-14 L13.1728576,2.84217094e-14 C5.87500907,-1.71479982e-05 0,4.96022995 0,11.1214886 Z" id="rect1171"></path>
                            <path d="M116.37005,0 L116,100.904964 C116,111.483663 123.258008,120 132.273377,120 L236,120 L116.37005,0 L116.37005,0 Z" id="rect1794"></path>
                        </g>
                        <path d="M47.803141,294.093878 C48.4999811,295.177551 48.9495553,296.095918 49.4216083,296.995918 C50.1184484,297.895918 50.5680227,298.630612 51.2873415,299.365306 C52.2089688,300.44898 53.3778619,301 54.7490634,301 C56.1427436,301 57.0643709,300.632653 57.761211,299.916327 C58.4580511,299.365306 58.9076254,298.465306 58.9076254,297.381633 C58.9076254,296.830612 58.9076254,295.930612 58.6828382,294.828571 C58.4355724,293.561224 58.2107852,292.844898 58.2107852,292.477551 C57.7387323,287.757143 57.5139451,283.753061 57.5139451,279.95102 C57.5139451,273.228571 58.4355724,267.057143 59.8292526,261.602041 C61.44772,256.165306 63.5382403,251.610204 66.0783349,247.62449 C68.8656954,243.620408 72.3274172,240.35102 76.4859792,237.44898 C80.6445412,234.546939 85.2751561,232.177551 90.1305582,230.359184 C94.9859603,228.540816 100.76299,227.089796 107.236859,226.006122 C113.710728,225.087755 120.409385,224.371429 127.13052,223.820408 C133.829177,223.453061 141.247152,223.269388 149.811542,223.269388 L167.704598,223.269388 L167.704598,249.057143 C167.704598,250.87551 168.401438,252.326531 170.019905,253.593878 C171.86316,254.861224 173.728893,255.595918 176.021722,255.595918 C178.112242,255.595918 180.180284,254.861224 181.82123,253.593878 L247.751296,201.834694 C249.369763,200.567347 250.291391,199.116327 250.291391,197.297959 C250.291391,195.479592 249.369763,194.028571 247.751296,192.761224 L181.82123,141.002041 C180.202763,139.734694 178.112242,139 176.044201,139 C173.728893,139 171.885639,139.734694 170.042384,141.002041 C168.423917,142.269388 167.727077,143.720408 167.727077,145.538776 L167.727077,171.326531 L149.811542,171.326531 C88.5120908,171.326531 50.8152886,184.955102 36.9234437,212.193878 C32.3153075,221.267347 30,232.526531 30,245.971429 C30,257.046939 35.5522422,272.291837 46.4094607,291.540816 C46.6567266,292.091837 47.1063009,292.826531 47.803141,294.093878 Z" id="Shape-Copy" fill="#000000" fill-rule="nonzero" transform="translate(140.145695, 220.000000) scale(-1, 1) translate(-140.145695, -220.000000) "></path>
                    </g>
                </g>

                <!-- Up arrow -->
                <g id="up-arrow" transform="translate(-279.22 -208.12)">
                    <path transform="matrix(.22413 0 0 .12089 335.67 164.35)" stroke-width="0" d="m-194.17 412.01h-28.827-28.827l14.414-24.965 14.414-24.965 14.414 24.965z"/>
                </g>

                <!-- Down arrow -->
                <g id="down-arrow" transform="translate(-279.22 -208.12)">
                    <path transform="matrix(.22413 0 0 -.12089 335.67 257.93)" stroke-width="0" d="m-194.17 412.01h-28.827-28.827l14.414-24.965 14.414-24.965 14.414 24.965z"/>
                </g>
            </defs>
        </svg>

        <header>
            <h1>
                <a href="">/</a>
            </h1>
        </header>
        <main>
            <div class="meta">
                <div id="summary">
                    <span class="meta-item"><b>1</b> directory</span>
                    <span class="meta-item"><b>0</b> files</span>
                    <span class="meta-item"><input type="text" placeholder="filter" id="filter" onkeyup='filter()'></span>
                </div>
            </div>
            <div class="listing">
                <table aria-describedby="summary">
                    <thead>
                    <tr>
                        <th>
                            <a href="?sort=namedirfirst&order=desc" class="icon"><svg width="1em" height=".5em" version="1.1" viewBox="0 0 12.922194 6.0358899"><use xlink:href="#up-arrow"></use></svg></a>
                            <a href="?sort=name&order=asc">Name</a>
                        </th>
                        <th>
                            <a href="?sort=size&order=asc">Size</a>
                        </th>
                        <th class="hideable">
                            <a href="?sort=time&order=asc">Modified</a>
                        </th>
                    </tr>
                    </thead>
                    <tbody>
                    <tr class="file">
                        <td>
                            <a href="./content/">
                                <svg width="1.5em" height="1em" version="1.1" viewBox="0 0 317 259"><use xlink:href="#folder"></use></svg>
                                <span class="name">content</span>
                            </a>
                        </td>
                        <td data-order="-1">&mdash;</td>
                        <td class="hideable"><time datetime="2018-05-05T11:13:56Z">05/05/2018 11:13:56 AM +00:00</time></td>
                    </tr>
                    </tbody>
                </table>
            </div>
        </main>
        <footer>
            Served with <a rel="noopener noreferrer" href="https://caddyserver.com">Caddy</a>
        </footer>
        <script>
            var filterEl = document.getElementById('filter');
            filterEl.focus();

            function filter() {
                var q = filterEl.value.trim().toLowerCase();
                var elems = document.querySelectorAll('tr.file');
                elems.forEach(function(el) {
                    if (!q) {
                        el.style.display = '';
                        return;
                    }
                    var nameEl = el.querySelector('.name');
                    var nameVal = nameEl.textContent.trim().toLowerCase();
                    if (nameVal.indexOf(q) !== -1) {
                        el.style.display = '';
                    } else {
                        el.style.display = 'none';
                    }
                });
            }

            function localizeDatetime(e, index, ar) {
                if (e.textContent === undefined) {
                    return;
                }
                var d = new Date(e.getAttribute('datetime'));
                if (isNaN(d)) {
                    d = new Date(e.textContent);
                    if (isNaN(d)) {
                        return;
                    }
                }
                e.textContent = d.toLocaleString([], {day: "2-digit", month: "2-digit", year: "numeric", hour: "2-digit", minute: "2-digit", second: "2-digit"});
            }
            var timeList = Array.prototype.slice.call(document.getElementsByTagName("time"));
            timeList.forEach(localizeDatetime);
        </script>
    </body>
* Connection #0 to host content-repository left intact
</html>
oc -n pgarg-1-jenkins get svc/content-repository -ojson | jq -r .spec.clusterIP
172.30.0.33
oc -n pgarg-1-jenkins get po/jenkins-3-5c8tj -ojson | jq -r .spec.nodeName
ip-172-31-69-36.us-east-2.compute.internal
oc -n pgarg-1-jenkins get po/content-repository-3-m6lpq -ojson | jq -r .spec.nodeName
ip-172-31-64-172.us-east-2.compute.internal
oc -n pgarg-1-jenkins rsh content-repository-3-m6lpq curl -s -o /dev/null
curl: no URL specified!
curl: try 'curl --help' or 'curl --manual' for more information
command terminated with exit code 2
hrishin commented 6 years ago

It's a classical issue for S2I build. https://github.com/openshiftio/openshift.io/issues/2729. Its happening either due to quota limit for pod (build requires additional pod) or issue on OSO when its receives large build loads

It has nothing to do with space or sprinboot quickstart.

hrishin commented 6 years ago

Additionally, we making changes on FMP side to log right failuare messages.

rohanKanojia commented 6 years ago

Since fabric8io/fabric8-maven-plugin#1284 is merged, now we won't get this confusing SocketTimeoutException but some descriptive message of actually indicating what went wrong.

piyush-garg commented 6 years ago

But that will happen in OSIO, after fmp 3.5.40 get released and that gets reflected in boosters. So this is still there in OSIO.

krishnapaparaju commented 6 years ago

@rohanKanojia can you please try to reproduce, if not frequent we can take out P0 label. Please track the log related (logging failure content) into a different issue..

piyush-garg commented 6 years ago

@rohanKanojia @krishnapaparaju @hrishin

Better error logging PR has been merged in FMP, still not in boosters yet. But I have an observation that as this is an intermittent issue. While fixing #3450 when we downgraded the RAM to use 1 GB, we faced the same issue, so it is something happening when Jenkins namespace does not have enough space to create a new pod and may be occurring because of #3349 also. Just an observation, not sure.

piyush-garg commented 6 years ago

FMP 3.5.40 has been released with the fix for better error logging. We need to include that in boosters now

cc @rohanKanojia @hrishin @krishnapaparaju @pradeepto

piyush-garg commented 6 years ago

Issue created for updating the FMP version in boosters https://github.com/openshiftio/booster-parent/issues/29

lordofthejars commented 6 years ago

So what are the next steps regarding this issue?

ldimaggi commented 6 years ago

When the update to FMP is in the boosters, this test can be retried and, if fixed, the issue can then be closed .

piyush-garg commented 6 years ago

After updating the FMP version, we need to reproduce this and figure out the issue, as better logging has been added in FMP. So that we may get to know the root cause of this.

lordofthejars commented 6 years ago

@ldimaggi @piyush1594 who is in charge of updating the booster? we (build team) ca help on this or it is managed by boosters team as well the update of FMP.

piyush-garg commented 6 years ago

@lordofthejars It is managed by the booster team, as they upgrade and do the release they update our catalogue also, so I think we can't do anything for this.

bartoszmajsak commented 6 years ago

@piyush1594 @lordofthejars we probably could think about some automation around that

ppitonak commented 6 years ago

Any updates?

piyush-garg commented 6 years ago

@ppitonak This needs to be reproduced to further resolve this.

hrishin commented 6 years ago

Its good to close now. As build is reporting a correct error message if S2I builds fails. @ppitonak @ldimaggi

[ERROR] Failed to execute goal io.fabric8:fabric8-maven-plugin:3.5.40:build (default) on project wf-health-check-redhat-001: Failed to execute the build: Unable to build the image using the OpenShift build service: CannotCreateBuildPod Failed creating build pod. -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal io.fabric8:fabric8-maven-plugin:3.5.40:build (default) on project wf-health-check-redhat-001: Failed to execute the build
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
    at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
    at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
    at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
    at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
    at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Failed to execute the build
    at io.fabric8.maven.plugin.mojo.build.BuildMojo.buildAndTag(BuildMojo.java:278)
    at io.fabric8.maven.docker.BuildMojo.executeInternal(BuildMojo.java:44)
    at io.fabric8.maven.plugin.mojo.build.BuildMojo.executeInternal(BuildMojo.java:236)
    at io.fabric8.maven.docker.AbstractDockerMojo.execute(AbstractDockerMojo.java:223)
    at io.fabric8.maven.plugin.mojo.build.BuildMojo.execute(BuildMojo.java:207)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
    ... 20 more
Caused by: io.fabric8.maven.core.service.Fabric8ServiceException: Unable to build the image using the OpenShift build service
    at io.fabric8.maven.core.service.openshift.OpenshiftBuildService.logBuildFailure(OpenshiftBuildService.java:621)
    at io.fabric8.maven.core.service.openshift.OpenshiftBuildService.build(OpenshiftBuildService.java:123)
    at io.fabric8.maven.plugin.mojo.build.BuildMojo.buildAndTag(BuildMojo.java:275)
    ... 26 more
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: CannotCreateBuildPod Failed creating build pod.
    ... 29 more
piyush-garg commented 6 years ago

This issue is just closed because now build will throw error message now whey it is failing that was not the case previously. Till now, what we have seen is build fails because of resource quota issue. Hence closed.