search

fabric8io / fabric8

fabric8 is an open source microservices platform based on Docker, Kubernetes and Jenkins
http://fabric8.io/
1.76k stars 504 forks source link

ingress-nginx,Error scheduling: No suitable offers for pod/task #6292

Open BoriszhangSec opened 8 years ago

BoriszhangSec commented 8 years ago

hello all: im deploy k8s on mesos,k8s version 1.3.4 i want deploy fabric8, ingress-nginx always no success.

scheduler log error : I0827 11:40:21.805054 8954 errorhandler.go:59] Error scheduling ingress-nginx-2458897146-u00br: No suitable offers for pod/task; retrying I0827 11:40:21.805409 8954 event.go:216] Event(api.ObjectReference{Kind:"Pod", Namespace:"fabric8", Name:"ingress-nginx-2458897146-u00br", UID:"f5203862-6c07-11e6-8474-848f69dc9aa5", APIVersion:"v1", ResourceVersion:"318355", FieldPath:""}): type: 'Warning' reason: 'FailedScheduling' Error scheduling: No suitable offers for pod/task

Please help me to look at,thanks

BoriszhangSec commented 8 years ago

This lead to I can not create applications [k8s-objects] Using polling for kind: buildconfigs http://192.168.1.151:8080/api/v1/namespaces/default/ingresses Failed to load resource: the server responded with a status of 404 (Not Found) hawtio-core.js:81 [k8s-objects] Failed to fetch data while connecting to backend for type: ingresses error: Object client.ts:415 WebSocket connection to 'ws://192.168.1.151:8080/api/v1/namespaces/default/ingresses?watch=true&access_token' failed: Error during WebSocket handshake: Unexpected response code: 404 http://192.168.1.151:8080/oapi/v1/namespaces/default/buildconfigs Failed to load resource: the server responded with a status of 404 (Not Found) http://192.168.1.151:8080/api/v1/namespaces/default/ingresses Failed to load resource: the server responded with a status of 404 (Not Found) hawtio-core.js:81 [fabric8-console] started, version:
hawtio-core.js:81 [fabric8-console] commit ID: undefined client.ts:447 WebSocket connection to 'ws://192.168.1.151:8080/api/v1/namespaces/default/configmaps?watch=true&access_token' failed: WebSocket is closed before the connection is established. client.ts:447 WebSocket connection to 'ws://192.168.1.151:8080/apis/extensions/v1beta1/ingresses?watch=true&access_token' failed: WebSocket is closed before the connection is established.

rawlingsj commented 8 years ago

Sorry for not replying sooner, this issue slipped past.

Did you figure out the issue deploying the ingress controller? It looks like you might have, I guess it was low resources available on nodes?

I think the second comment and issue may not be an issue, it might be some over the top logging. Can you explain a little about where in the create project process you managed to get please?

Also a gist of the fabric8-forge pod logs might show something too.

BoriszhangSec commented 8 years ago

Thank you very much for your time @rawlingsj

I can in f8-console access components, only ingress - nginx cannot be created I node resources abundant, I doubt yaml files and the underlying environmental rules do not match

fabric8-forge log: ID: 35426 Address: http://192.168.1.155:31007/api/forge/command/execute/project-new?kubeUserName=admin&secret=gogs-https-admin&secretNamespace=user-secrets-source-admin Encoding: UTF-8 Http-Method: POST Content-Type: application/json;charset=UTF-8 Headers: {Accept=[application/json, text/plain, /], accept-encoding=[gzip, deflate], Accept-Language=[zh-CN,zh;q=0.8], Content-Length=[206], content-type=[application/json;charset=UTF-8], Cookie=[lang=zh-CN; utma=82103894.1088649911.1472286384.1472286384.1472286384.1; utmz=82103894.1472286384.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); __hstc=129814099.c1ee5e6254eae64a755f2076fc760b23.1472286385850.1472286385850.1472286385850.1; hsfirstvisit=http%3A%2F%2F192.168.1.151%3A30889%2Fservice%2Flocal%2Foutreach%2Fwelcome%2F%3Fversion%3D2.13.0-01%26versionMm%3D2.13%26edition%3DOSS%26usertype%3Danonymous|http%3A%2F%2F192.168.1.151%3A30889%2F|1472286385841; hubspotutk=c1ee5e6254eae64a755f2076fc760b23], Host=[192.168.1.155:31007], Origin=[http://192.168.1.151:9000], Referer=[http://192.168.1.151:9000/workspaces/web-dev/forge/command/project-new], User-Agent=[Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36], X-Forwarded-Uri=[/api/v1/proxy/namespaces/web-dev/services/fabric8-forge:80/api/forge/command/execute/project-new]}

Payload: {"namespace":"web-dev","resource":"","inputList":[{"type":"PHP","topLevelPackage":"org.example","version":"1.0.0-SNAPSHOT","targetLocation":"/opt/jboss","stack":"None","overwrite":false,"named":"test005"}]}

Both io.fabric8.forge.rest.CommandsResource#executeCommand and io.fabric8.forge.rest.CommandsResource#executeCommand are equal candidates for handling the current request which can lead to unpredictable results Stashing local changes to the repo Performing a pull in git repository /tmp/fabric8-forge/jenkinsWorkflows/.git on remote URL: https://github.com/fabric8io/jenkins-workflow-library.git Using UsernamePasswordCredentialsProvider{user: gogsadmin, password length: 0} About to invoked command project-new stepValidation: ValidationResult{messages=[], valid=true, canExecute=true, out='', err=''} messages: [] with ExecutionRequest{resource='', inputs=[{type=PHP, topLevelPackage=org.example, version=1.0.0-SNAPSHOT, targetLocation=/tmp/fabric8-forge/user/gogsadmin, stack=None, overwrite=false, named=test005}], promptQueue=null} Creating archetype using Maven groupId: org.example, artifactId: test005, version: 1.0.0-SNAPSHOT in directory: /tmp/fabric8-forge/user/gogsadmin/test005 Using replace properties: {} Trusting all SSL certificates Initialised an empty git configuration repo at /tmp/fabric8-forge/user/gogsadmin/test005 creating git repository client at: http://10.10.10.172:80/ Using remoteUrl: http://10.10.10.172:80/gogsadmin/test005.git and remote name origin Commiting and pushing to: http://10.10.10.172:80/gogsadmin/test005.git and remote name origin Using UsernamePasswordCredentialsProvider{user: gogsadmin, password length: 8} Creating a BuildConfig for namespace: web-dev project: test005 Could not lookup service:jenkins in namespace:web-dev, due to: An error has occurred. Connecting to service jenkins on 10.10.10.173:80 from $JENKINS_SERVICE_HOST and $JENKINS_SERVICE_PORT Caught: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:57)[kubernetes-client-1.4.6.jar:] at io.fabric8.kubernetes.client.dsl.base.BaseOperation.getRootPaths(BaseOperation.java:156)[kubernetes-client-1.4.6.jar:] at io.fabric8.kubernetes.client.BaseClient.rootPaths(BaseClient.java:150)[kubernetes-client-1.4.6.jar:] at io.fabric8.openshift.client.OpenshiftAdapterSupport.isOpenShift(OpenshiftAdapterSupport.java:51)[openshift-client-1.4.6.jar:] at io.fabric8.openshift.client.OpenshiftAdapterSupport.isAdaptable(OpenshiftAdapterSupport.java:35)[openshift-client-1.4.6.jar:] at io.fabric8.openshift.client.OpenShiftExtensionAdapter.adapt(OpenShiftExtensionAdapter.java:45)[openshift-client-1.4.6.jar:] at io.fabric8.openshift.client.OpenShiftExtensionAdapter.adapt(OpenShiftExtensionAdapter.java:33)[openshift-client-1.4.6.jar:] at io.fabric8.kubernetes.client.BaseClient.adapt(BaseClient.java:142)[kubernetes-client-1.4.6.jar:] at sun.reflect.GeneratedMethodAccessor865.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[:1.8.0_91] at java.lang.reflect.Method.invoke(Method.java:498)[:1.8.091] at org.jboss.weld.bean.proxy.AbstractBeanInstance.invoke(AbstractBeanInstance.java:38)[weld-servlet-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100)[weld-servlet-2.3.5.Final.jar:2.3.5.Final] at io.fabric8.kubernetes.client.KubernetesClient$418356913$Proxy$$$_WeldClientProxy.adapt(Unknown Source)[weld-servlet-2.3.5.Final.jar:] at io.fabric8.kubernetes.api.Controller.getOpenShiftClientOrNull(Controller.java:403)[kubernetes-api-2.2.156.jar:2.2.156] at io.fabric8.kubernetes.api.Controller.getOpenShiftClientOrJenkinshift(Controller.java:411)[kubernetes-api-2.2.156.jar:2.2.156] at io.fabric8.kubernetes.api.Controller.applyBuildConfig(Controller.java:785)[kubernetes-api-2.2.156.jar:2.2.156] at io.fabric8.forge.rest.main.GitCommandCompletePostProcessor.createBuildConfig(GitCommandCompletePostProcessor.java:206)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.main.GitCommandCompletePostProcessor.firePostCompleteActions(GitCommandCompletePostProcessor.java:175)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource.doExecute(CommandsResource.java:385)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource$4.apply(CommandsResource.java:279)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource$4.apply(CommandsResource.java:275)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource.withUIContext(CommandsResource.java:600)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource.withUIContext(CommandsResource.java:561)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource.executeCommand(CommandsResource.java:275)[fabric8-forge-core-2.3.17.jar:2.3.17] at sun.reflect.GeneratedMethodAccessor684.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[:1.8.0_91] at java.lang.reflect.Method.invoke(Method.java:498)[:1.8.0_91] at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:189)[cxf-rt-frontend-jaxrs-3.1.6.jar:3.1.6] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:99)[cxf-rt-frontend-jaxrs-3.1.6.jar:3.1.6] at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:254)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:180)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:298)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:217)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)[servlet-api-3.1.jar:3.1.0] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:273)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:837)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)[jetty-security-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.Server.handle(Server.java:524)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:253)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at java.lang.Thread.run(Thread.java:745)[:1.8.0_91] Failed to invoke command project-new on ExecutionRequest{resource='', inputs=[{type=PHP, topLevelPackage=org.example, version=1.0.0-SNAPSHOT, targetLocation=/tmp/fabric8-forge/user/gogsadmin, stack=None, overwrite=false, named=test005}], promptQueue=null}. java.lang.RuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. java.lang.RuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. at io.fabric8.forge.rest.main.GitCommandCompletePostProcessor.handleException(GitCommandCompletePostProcessor.java:251)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.main.GitCommandCompletePostProcessor.firePostCompleteActions(GitCommandCompletePostProcessor.java:187)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource.doExecute(CommandsResource.java:385)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource$4.apply(CommandsResource.java:279)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource$4.apply(CommandsResource.java:275)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource.withUIContext(CommandsResource.java:600)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource.withUIContext(CommandsResource.java:561)[fabric8-forge-core-2.3.17.jar:2.3.17] at io.fabric8.forge.rest.CommandsResource.executeCommand(CommandsResource.java:275)[fabric8-forge-core-2.3.17.jar:2.3.17] at sun.reflect.GeneratedMethodAccessor684.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[:1.8.0_91] at java.lang.reflect.Method.invoke(Method.java:498)[:1.8.0_91] at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:189)[cxf-rt-frontend-jaxrs-3.1.6.jar:3.1.6] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:99)[cxf-rt-frontend-jaxrs-3.1.6.jar:3.1.6] at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:254)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:180)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:298)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:217)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)[servlet-api-3.1.jar:3.1.0] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:273)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:837)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)[jetty-security-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.Server.handle(Server.java:524)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:253)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at java.lang.Thread.run(Thread.java:745)[:1.8.0_91] Application {http://rest.forge.fabric8.io/}CommandsResource has thrown exception, unwinding now: java.lang.RuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. Exception in handleFault on interceptor org.apache.cxf.jaxrs.interceptor.JAXRSDefaultFaultOutInterceptor@118fa55a org.apache.cxf.interceptor.Fault: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. at org.apache.cxf.service.invoker.AbstractInvoker.createFault(AbstractInvoker.java:162)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:128)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:189)[cxf-rt-frontend-jaxrs-3.1.6.jar:3.1.6] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:99)[cxf-rt-frontend-jaxrs-3.1.6.jar:3.1.6] at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:254)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:180)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:298)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:217)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)[servlet-api-3.1.jar:3.1.0] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:273)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:837)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)[jetty-security-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.Server.handle(Server.java:524)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:253)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at java.lang.Thread.run(Thread.java:745)[:1.8.0_91] Error occurred during error handling, give up! org.apache.cxf.interceptor.Fault: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. at org.apache.cxf.service.invoker.AbstractInvoker.createFault(AbstractInvoker.java:162)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:128)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:189)[cxf-rt-frontend-jaxrs-3.1.6.jar:3.1.6] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:99)[cxf-rt-frontend-jaxrs-3.1.6.jar:3.1.6] at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)[cxf-core-3.1.6.jar:3.1.6] at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:254)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:180)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:298)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:217)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)[servlet-api-3.1.jar:3.1.0] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:273)[cxf-rt-transports-http-3.1.6.jar:3.1.6] at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:837)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)[jetty-security-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)[jetty-servlet-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.Server.handle(Server.java:524)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:253)[jetty-server-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)[jetty-io-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)[jetty-util-9.3.10.v20160621.jar:9.3.10.v20160621] at java.lang.Thread.run(Thread.java:745)[:1.8.091] 2016-08-31 10:52:20.897:WARN:oejs.ServletHandler:qtp1134612201-31: /api/forge/command/execute/project-new java.lang.RuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. at io.fabric8.forge.rest.main.GitCommandCompletePostProcessor.handleException(GitCommandCompletePostProcessor.java:251) at io.fabric8.forge.rest.main.GitCommandCompletePostProcessor.firePostCompleteActions(GitCommandCompletePostProcessor.java:187) at io.fabric8.forge.rest.CommandsResource.doExecute(CommandsResource.java:385) at io.fabric8.forge.rest.CommandsResource$4.apply(CommandsResource.java:279) at io.fabric8.forge.rest.CommandsResource$4.apply(CommandsResource.java:275) at io.fabric8.forge.rest.CommandsResource.withUIContext(CommandsResource.java:600) at io.fabric8.forge.rest.CommandsResource.withUIContext(CommandsResource.java:561) at io.fabric8.forge.rest.CommandsResource.executeCommand(CommandsResource.java:275) at sun.reflect.GeneratedMethodAccessor684.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:189) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:99) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:254) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:180) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:298) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:217) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:273) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:837) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:524) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:253) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:745) Caused by: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:57) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.getRootPaths(BaseOperation.java:156) at io.fabric8.kubernetes.client.BaseClient.rootPaths(BaseClient.java:150) at io.fabric8.openshift.client.OpenshiftAdapterSupport.isOpenShift(OpenshiftAdapterSupport.java:51) at io.fabric8.openshift.client.OpenshiftAdapterSupport.isAdaptable(OpenshiftAdapterSupport.java:35) at io.fabric8.openshift.client.OpenShiftExtensionAdapter.adapt(OpenShiftExtensionAdapter.java:45) at io.fabric8.openshift.client.OpenShiftExtensionAdapter.adapt(OpenShiftExtensionAdapter.java:33) at io.fabric8.kubernetes.client.BaseClient.adapt(BaseClient.java:142) at sun.reflect.GeneratedMethodAccessor865.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.bean.proxy.AbstractBeanInstance.invoke(AbstractBeanInstance.java:38) at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) at io.fabric8.kubernetes.client.KubernetesClient$418356913$Proxy$$$_WeldClientProxy.adapt(Unknown Source) at io.fabric8.kubernetes.api.Controller.getOpenShiftClientOrNull(Controller.java:403) at io.fabric8.kubernetes.api.Controller.getOpenShiftClientOrJenkinshift(Controller.java:411) at io.fabric8.kubernetes.api.Controller.applyBuildConfig(Controller.java:785) at io.fabric8.forge.rest.main.GitCommandCompletePostProcessor.createBuildConfig(GitCommandCompletePostProcessor.java:206) at io.fabric8.forge.rest.main.GitCommandCompletePostProcessor.firePostCompleteActions(GitCommandCompletePostProcessor.java:175) at io.fabric8.forge.rest.CommandsResource.doExecute(CommandsResource.java:385) at io.fabric8.forge.rest.CommandsResource$4.apply(CommandsResource.java:279) at io.fabric8.forge.rest.CommandsResource$4.apply(CommandsResource.java:275) at io.fabric8.forge.rest.CommandsResource.withUIContext(CommandsResource.java:600) at io.fabric8.forge.rest.CommandsResource.withUIContext(CommandsResource.java:561) at io.fabric8.forge.rest.CommandsResource.executeCommand(CommandsResource.java:275) at sun.reflect.GeneratedMethodAccessor684.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:189) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:99) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:254) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:180) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:298) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:217) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:273) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:837) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:524) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:253) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.SocketException: Connection reset at java.net.SocketInputStream.read(SocketInputStream.java:209) at java.net.SocketInputStream.read(SocketInputStream.java:141) at sun.security.ssl.InputRecord.readFully(InputRecord.java:465) at sun.security.ssl.InputRecord.read(InputRecord.java:503) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973) at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387) at okhttp3.internal.connection.RealConnection.connectTls(RealConnection.java:241) at okhttp3.internal.connection.RealConnection.establishProtocol(RealConnection.java:198) at okhttp3.internal.connection.RealConnection.buildConnection(RealConnection.java:174) at okhttp3.internal.connection.RealConnection.connect(RealConnection.java:114) at okhttp3.internal.connection.StreamAllocation.findConnection(StreamAllocation.java:193) at okhttp3.internal.connection.StreamAllocation.findHealthyConnection(StreamAllocation.java:129) at okhttp3.internal.connection.StreamAllocation.newStream(StreamAllocation.java:98) at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:42) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:109) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:124) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:170) at okhttp3.RealCall.execute(RealCall.java:60) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:234) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:229) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.getRootPaths(BaseOperation.java:149) at io.fabric8.kubernetes.client.BaseClient.rootPaths(BaseClient.java:150) at io.fabric8.openshift.client.OpenshiftAdapterSupport.isOpenShift(OpenshiftAdapterSupport.java:51) at io.fabric8.openshift.client.OpenshiftAdapterSupport.isAdaptable(OpenshiftAdapterSupport.java:35) at io.fabric8.openshift.client.OpenShiftExtensionAdapter.adapt(OpenShiftExtensionAdapter.java:45) at io.fabric8.openshift.client.OpenShiftExtensionAdapter.adapt(OpenShiftExtensionAdapter.java:33) at io.fabric8.kubernetes.client.BaseClient.adapt(BaseClient.java:142) at sun.reflect.GeneratedMethodAccessor865.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.bean.proxy.AbstractBeanInstance.invoke(AbstractBeanInstance.java:38) at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) at io.fabric8.kubernetes.client.KubernetesClient$418356913$Proxy$_$$_WeldClientProxy.adapt(Unknown Source) at io.fabric8.kubernetes.api.Controller.getOpenShiftClientOrNull(Controller.java:403) at io.fabric8.kubernetes.api.Controller.getOpenShiftClientOrJenkinshift(Controller.java:411) at io.fabric8.kubernetes.api.Controller.applyBuildConfig(Controller.java:785) at io.fabric8.forge.rest.main.GitCommandCompletePostProcessor.createBuildConfig(GitCommandCompletePostProcessor.java:206) at io.fabric8.forge.rest.main.GitCommandCompletePostProcessor.firePostCompleteActions(GitCommandCompletePostProcessor.java:175) at io.fabric8.forge.rest.CommandsResource.doExecute(CommandsResource.java:385) at io.fabric8.forge.rest.CommandsResource$4.apply(CommandsResource.java:279) at io.fabric8.forge.rest.CommandsResource$4.apply(CommandsResource.java:275) at io.fabric8.forge.rest.CommandsResource.withUIContext(CommandsResource.java:600) at io.fabric8.forge.rest.CommandsResource.withUIContext(CommandsResource.java:561) at io.fabric8.forge.rest.CommandsResource.executeCommand(CommandsResource.java:275) at sun.reflect.GeneratedMethodAccessor684.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:189) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:99) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:254) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:234) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:208) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:160) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:180) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:298) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:217) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:273) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:837) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:524) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:253) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:745) Inbound Message

best regard

rawlingsj commented 8 years ago

Ok so there's a couple of things we can check

Did gofabric8 add the externalIP label to a node? We need that to deploy the nginx-controller:

kubectl get nodes -l externalIP=true

can you grab the replica set events?

kubectl describe rs ingress-nginx

The error in the forge log above looks suspicious too java.net.SocketException: Connection reset when trying to access the api server. @iocanel don't suppose you have any thoughts around the socket exception do you?

BoriszhangSec commented 8 years ago

kubectl get nodes --show-labels NAME STATUS AGE LABELS 192.168.1.151 Ready 8d externalIP=true,kubernetes.io/hostname=192.168.1.151,role=nginxplus 192.168.1.152 Ready 8d externalIP=true,kubernetes.io/hostname=192.168.1.152,role=nginxplus 192.168.1.153 Ready 8d externalIP=true,kubernetes.io/hostname=192.168.1.153,role=nginxplus 192.168.1.154 Ready 8d externalIP=true,kubernetes.io/hostname=192.168.1.154,role=nginxplus 192.168.1.155 Ready 9d externalIP=true,kubernetes.io/hostname=192.168.1.155,role=nginxplus

kubectl describe rs ingress-nginx --namespace=web-dev Name: ingress-nginx-2458897146 Namespace: web-dev Image(s): nginxdemos/nginx-ingress:0.3 Selector: group=io.fabric8.devops.apps,pod-template-hash=2458897146,project=ingress-nginx,provider=fabric8 Labels: group=io.fabric8.devops.apps pod-template-hash=2458897146 project=ingress-nginx provider=fabric8 version=2.2.242 Replicas: 1 current / 1 desired Pods Status: 0 Running / 1 Waiting / 0 Succeeded / 0 Failed No volumes. No events.

rawlingsj commented 8 years ago

Ok thats interesting. To start with I've just fixed the duplicate label issue this morning https://github.com/fabric8io/gofabric8/issues/97

I'll release that now but in the meantime we can manually remove the labels and apply it to the one node you want it on.

kubectl label node 192.168.1.151 externalIP-
kubectl label node 192.168.1.153 externalIP-
kubectl label node 192.168.1.154 externalIP-
kubectl label node 192.168.1.155 externalIP-

now add it to a node that you have an external ip on.. e.g.

kubectl label node 192.168.1.151 externalIP=true

What does kubectl get pods --namespace=web-dev give you?

BoriszhangSec commented 8 years ago

Has been performed @rawlingsj kubectl get nodes --show-labels NAME STATUS AGE LABELS 192.168.1.151 Ready 8d externalIP=true,kubernetes.io/hostname=192.168.1.151,role=nginxplus 192.168.1.152 Ready 8d kubernetes.io/hostname=192.168.1.152,role=nginxplus 192.168.1.153 Ready 8d kubernetes.io/hostname=192.168.1.153,role=nginxplus 192.168.1.154 Ready 8d kubernetes.io/hostname=192.168.1.154,role=nginxplus 192.168.1.155 Ready 9d kubernetes.io/hostname=192.168.1.155,role=nginxplus

kubectl get pods --namespace=web-dev NAME READY STATUS RESTARTS AGE fabric8-docker-registry-2545547314-xovqz 1/1 Running 0 1d fabric8-forge-264315402-z966o 1/1 Running 0 4d gogs-217092172-7bw8j 1/1 Running 0 4d ingress-nginx-2458897146-dky6x 0/1 Pending 0 2h jenkins-2589937665-a081w 1/1 Running 0 4d nexus-385940273-8ez7s 1/1 Running 0 4d

rawlingsj commented 8 years ago

Ok great thanks @BoriszhangSec , can we now take a look at the events from the ingress pod please?

kubectl describe pod ingress-nginx-2458897146-dky6x
BoriszhangSec commented 8 years ago

describe pod ingress-nginx-2458897146-dky6x --namespace=web-dev Name: ingress-nginx-2458897146-dky6x Namespace: web-dev Node: / Labels: group=io.fabric8.devops.apps pod-template-hash=2458897146 project=ingress-nginx provider=fabric8 version=2.2.242 Status: Pending IP:
Controllers: ReplicaSet/ingress-nginx-2458897146 Containers: nginx-ingress: Image: nginxdemos/nginx-ingress:0.3 Ports: 80/TCP, 443/TCP Args: -v=3 -nginx-configmaps=default/nginx-config Environment Variables: No volumes. QoS Tier: BestEffort Events: FirstSeen LastSeen Count From SubobjectPath Type Reason Message

2h 0s 363 {default-scheduler } Warning FailedScheduling Error scheduling: No suitable offers for pod/task

rawlingsj commented 8 years ago

Im not sure why kubernetes is unable to schedule the nginx-ingress pod onto node 192.168.1.151, is there anything in the kubelet or api server logs?

One other thing; I notice that there's also a role=nginxplus label on your nodes, I don't suppose you already have an nginx controller running? If you do I wonder if there's a conflict of some sort like a port clash?

BoriszhangSec commented 8 years ago

Thank you for your help @rawlingsj ，Role labels is used to test before I manually add and I have removed the role = nginxplus labels, looks like before mistakes,

kubectl get nodes --show-labels NAME STATUS AGE LABELS 192.168.1.151 Ready 8d externalIP=true,kubernetes.io/hostname=192.168.1.151 192.168.1.152 Ready 8d kubernetes.io/hostname=192.168.1.152 192.168.1.153 Ready 8d kubernetes.io/hostname=192.168.1.153 192.168.1.154 Ready 8d kubernetes.io/hostname=192.168.1.154 192.168.1.155 Ready 9d kubernetes.io/hostname=192.168.1.155

api log； Calling Accessor on non-internal object: I0901 10:12:22.099108 27757 handlers.go:165] PATCH /api/v1/namespaces/fabric8/events/exposecontroller-1625413132-3u547.146db8915bdc3948: (4.323375ms) 200 [[km/v1.3.4+dd6b458 (li nux/amd64) kubernetes/dd6b458] 192.168.1.152:51288] I0901 10:12:22.100655 27757 meta.go:86] Calling Accessor on non-internal object: I0901 10:12:22.104349 27757 handlers.go:165] PATCH /api/v1/namespaces/fabric8/events/exposecontroller-1625413132-3u547.146db83443b6edea: (4.053762ms) 200 [[km/v1.3.4+dd6b458 (li nux/amd64) kubernetes/dd6b458] 192.168.1.152:51288] I0901 10:12:23.036088 27757 handlers.go:165] GET /api/v1/namespaces/web-dev/secrets/gogs-token-qo0f2: (4.485776ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192. 168.1.155:60196] I0901 10:12:23.696388 27757 handlers.go:165] GET /api/v1/nodes/192.168.1.151: (3.276257ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192.168.1.151:55892] I0901 10:12:23.772892 27757 handlers.go:165] PUT /api/v1/nodes/192.168.1.151/status: (8.983986ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192.168.1.151:55892] I0901 10:12:23.782941 27757 handlers.go:165] GET /api/v1/namespaces/default/services/k8sm-scheduler: (1.490198ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192.1 68.1.151:56160] I0901 10:12:23.785366 27757 handlers.go:165] GET /api/v1/namespaces/default/endpoints/k8sm-scheduler: (1.49856ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192.1 68.1.151:56160] I0901 10:12:24.986535 27757 handlers.go:165] GET /api/v1/namespaces/kube-system/secrets/default-token-gkg7m: (3.519705ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b45 8] 192.168.1.154:60970] I0901 10:12:25.032038 27757 meta.go:86] Calling Accessor on non-internal object: *api.ConfigMapList I0901 10:12:25.156227 27757 handlers.go:165] GET /api/v1/nodes/192.168.1.153: (2.872618ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192.168.1.153:33638] I0901 10:12:25.198607 27757 handlers.go:165] PUT /api/v1/nodes/192.168.1.153/status: (7.693924ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192.168.1.153:33638] I0901 10:12:25.286961 27757 handlers.go:165] GET /api/v1/configmaps: (310.64877ms) 200 [[Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/ 52.0.2743.116 Safari/537.36] 192.168.1.17:50503] /qu I0901 10:12:33.777424 27757 handlers.go:165] GET /api/v1/nodes/192.168.1.151: (3.211905ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192.168.1.151:55892] I0901 10:12:33.854149 27757 handlers.go:165] PUT /api/v1/nodes/192.168.1.151/status: (9.420086ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192.168.1.151:55892] I0901 10:12:37.100972 27757 meta.go:86] Calling Accessor on non-internal object: I0901 10:12:43.795806 27757 handlers.go:165] GET /api/v1/namespaces/web-dev/endpoints/gogs-ssh: (1.73447ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoint-con troller] 192.168.1.151:56536] I0901 10:12:43.796156 27757 handlers.go:165] GET /api/v1/namespaces/fabric8/endpoints/fabric8-docker-registry: (1.331603ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b 458/endpoint-controller] 192.168.1.151:56540] I0901 10:12:43.796442 27757 handlers.go:165] GET /api/v1/namespaces/web-dev/endpoints/nexus: (1.488942ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoint-contr oller] 192.168.1.151:56544] I0901 10:12:43.796473 27757 handlers.go:165] GET /api/v1/namespaces/fabric8/endpoints/jenkinshift: (1.369867ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoint -controller] 192.168.1.151:56542] I0901 10:12:43.798110 27757 handlers.go:165] GET /api/v1/namespaces/fabric8/endpoints/fabric8: (1.204695ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoint-con troller] 192.168.1.151:56536] I0901 10:12:43.798609 27757 handlers.go:165] GET /api/v1/namespaces/fabric8/endpoints/fabric8-forge: (1.275341ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoi nt-controller] 192.168.1.151:56544] I0901 10:12:43.798758 27757 handlers.go:165] GET /api/v1/namespaces/fabric8/endpoints/nexus: (1.901763ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoint-contr oller] 192.168.1.151:56532] I0901 10:12:43.798857 27757 handlers.go:165] GET /api/v1/namespaces/web-dev/endpoints/fabric8-forge: (1.386909ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoi nt-controller] 192.168.1.151:56542] I0901 10:12:43.799233 27757 handlers.go:165] GET /api/v1/namespaces/fabric8/endpoints/jenkins: (1.237097ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoint-con troller] 192.168.1.151:56546] I0901 10:12:43.800375 27757 handlers.go:165] GET /api/v1/namespaces/web-dev/endpoints/gogs: (1.230818ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoint-contro ller] 192.168.1.151:56544] I0901 10:12:43.801271 27757 handlers.go:165] GET /api/v1/namespaces/fabric8/endpoints/kibana: (1.512844ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoint-cont roller] 192.168.1.151:56546] I0901 10:12:43.801300 27757 handlers.go:165] GET /api/v1/namespaces/web-dev/endpoints/jenkins: (1.665155ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoint-con troller] 192.168.1.151:56542] I0901 10:12:43.801364 27757 handlers.go:165] GET /api/v1/namespaces/web-dev/endpoints/jenkins-jnlp: (1.361424ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458/endpoin t-controller] 192.168.1.151:56536] I0901 10:12:43.858054 27757 handlers.go:165] GET /api/v1/nodes/192.168.1.151: (2.576318ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192.168.1.151:55892] I0901 10:12:43.934488 27757 handlers.go:165] PUT /api/v1/nodes/192.168.1.151/status: (9.598701ms) 200 [[km/v1.3.4+dd6b458 (linux/amd64) kubernetes/dd6b458] 192.168.1.151:55892] I0901 10:12:45.095021 27757 meta.go:86] Calling Accessor on non-internal object:

BoriszhangSec commented 8 years ago

In addition, this is my server configuration parameters km apiserver \ --allow-privileged=true \ --address=${KUBERNETES_MASTER_IP} \ --etcd-servers=${ETCD_URL} \ --service-cluster-ip-range=${SERVICE_CLUSTER_IP_RANGE} \ --port=${API_SERV_PORT} \ --cloud-provider=mesos \ --cloud-config=${MESOS_CLOUD_CONF} \ --insecure-bind-address=0.0.0.0 \ --insecure-port=8080 \ --tls-private-key-file=/var/run/kubernetes/server.key \ --tls-cert-file=/var/run/kubernetes/server.crt \ --address=0.0.0.0 \ --secure-port=0 \ --v=4 > /tmp/apiserver.log 2>&1 &

km scheduler \ --address=${KUBERNETES_MASTER_IP} \ --docker="unix:///var/run/docker.sock" \ --framework-name="Kubernetes" \ --allow-privileged=true \ --mesos-master=${MESOS_MASTER} \ --etcd-servers=${ETCD_URL} \ --mesos-user=root \ --api-servers=${API_SERV_URL} \ --cluster-dns=${CLUSTER_DNS} \ --cluster-domain=${CLUSTER_DOMAIN} \ --v=4 >/tmp/scheduler.log 2>&1 &

km controller-manager \ --master=${API_SERV_URL} \ --cloud-provider=mesos \ --address=0.0.0.0 \ --cluster-name="kubernetes" \ --namespace-sync-period=20m0s \ --service-account-private-key-file=/var/run/kubernetes/server.key \ --root-ca-file=/var/run/kubernetes/ca.crt \ --cloud-config=${MESOS_CLOUD_CONF} \ --v=4 >/tmp/controller.log 2>&1 &

I'm debugging