Cloud Gateway with Kubernetes not working

shahbour commented 5 years ago

I am trying to move from Zuul to Gateway after TokenRelayGatewayFilterFactory is released . I did the static route as below

    @Bean
    public RouteLocator customRouteLocator(RouteLocatorBuilder builder) {
        return builder.routes()
                .route("common", r -> r.path("/common/**")
                        .filters(f -> f.stripPrefix(1).filter(filterFactory.apply()))
                        .uri("http://10.100.135.181:8083"))
                .build();
    }

and it worked perfectly , but when trying to use the DiscoveryClient from kubernetes it is not working .

All services are being discovered , i can see that in the log but restTemplate is not trying to get the endpoint IP instead it is keeping the service name . I tried to set the url-expression to http://'+serviceId , but started getting hostname not found and with lb://service-id i am getting just 200 OK without any try to the service

2019-02-04 12:37:38.384 TRACE 16483 --- [ctor-http-nio-2] o.s.c.g.h.p.RoutePredicateFactory        : Pattern "/common/**" matches against value "/common/"
2019-02-04 12:37:38.384 DEBUG 16483 --- [ctor-http-nio-2] o.s.c.g.h.RoutePredicateHandlerMapping   : Route matched: CompositeDiscoveryClient_common
2019-02-04 12:37:38.384 DEBUG 16483 --- [ctor-http-nio-2] o.s.c.g.h.RoutePredicateHandlerMapping   : Mapping [Exchange: GET http://localhost:8080/common/] to Route{id='CompositeDiscoveryClient_common', uri=lb://common, order=0, predicate=org.springframework.cloud.gateway.support.ServerWebExchangeUtils$$Lambda$1027/166851221@19fa15e4, gatewayFilters=[OrderedGatewayFilter{delegate=org.springframework.cloud.gateway.filter.factory.RewritePathGatewayFilterFactory$$Lambda$1029/275745728@8d968c9, order=1}]}
2019-02-04 12:37:38.384 DEBUG 16483 --- [ctor-http-nio-2] o.s.c.g.h.RoutePredicateHandlerMapping   : [dd19dc7c] Mapped to org.springframework.cloud.gateway.handler.FilteringWebHandler@784f9602
2019-02-04 12:37:38.385 DEBUG 16483 --- [ctor-http-nio-2] o.s.c.g.handler.FilteringWebHandler      : Sorted gatewayFilterFactories: [OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.AdaptCachedBodyGlobalFilter@660b1a9d}, order=-2147482648}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.GatewayMetricsFilter@7f426ddd}, order=-2147473648}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.NettyWriteResponseFilter@587f4f63}, order=-1}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.ForwardPathFilter@2f4d01b6}, order=0}, OrderedGatewayFilter{delegate=org.springframework.cloud.gateway.filter.factory.RewritePathGatewayFilterFactory$$Lambda$1029/275745728@8d968c9, order=1}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.RouteToRequestUrlFilter@6fb0261e}, order=10000}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.WebsocketRoutingFilter@112c2930}, order=2147483646}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.NettyRoutingFilter@6d31f106}, order=2147483647}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.ForwardRoutingFilter@d6b532f}, order=2147483647}]
2019-02-04 12:37:38.391 TRACE 16483 --- [ctor-http-nio-2] o.s.c.g.filter.RouteToRequestUrlFilter   : RouteToRequestUrlFilter start
2019-02-04 12:37:38.398 TRACE 16483 --- [ctor-http-nio-2] o.s.w.s.adapter.HttpWebHandlerAdapter    : [dd19dc7c] Completed 200 OK, headers={masked}
2019-02-04 12:37:38.401 TRACE 16483 --- [ctor-http-nio-2] o.s.c.g.filter.GatewayMetricsFilter      : Stopping timer 'gateway.requests' with tags [tag(outcome=SUCCESSFUL),tag(routeId=CompositeDiscoveryClient_common),tag(routeUri=lb://common),tag(status=OK)]
2019-02-04 12:37:38.401 TRACE 16483 --- [ctor-http-nio-2] org.springframework.web.HttpLogging      : [dd19dc7c] Handling completed

A sample of the gateway is found here https://github.com/shahbour/gateway-demo

ryanjbaxter commented 5 years ago

Do the OAuth 2 components really have anything to do with the problem. If you take them out of your sample can you still reproduce the issue?

shahbour commented 5 years ago

I just removed the security from the sample and pushed it, the same thing happened. I don't know from where the 200 OK is coming.

019-02-04 16:37:48.841 DEBUG 17667 --- [ctor-http-nio-2] o.s.c.g.h.RoutePredicateHandlerMapping   : Route matched: CompositeDiscoveryClient_common
2019-02-04 16:37:48.842 DEBUG 17667 --- [ctor-http-nio-2] o.s.c.g.h.RoutePredicateHandlerMapping   : Mapping [Exchange: GET http://localhost:8080/common/] to Route{id='CompositeDiscoveryClient_common', uri=lb://common, order=0, predicate=org.springframework.cloud.gateway.support.ServerWebExchangeUtils$$Lambda$729/2008944346@3fabbbab, gatewayFilters=[OrderedGatewayFilter{delegate=org.springframework.cloud.gateway.filter.factory.RewritePathGatewayFilterFactory$$Lambda$731/539666337@c03010e, order=1}]}
2019-02-04 16:37:48.842 DEBUG 17667 --- [ctor-http-nio-2] o.s.c.g.h.RoutePredicateHandlerMapping   : [80c75051] Mapped to org.springframework.cloud.gateway.handler.FilteringWebHandler@57f210e8
2019-02-04 16:37:48.843 DEBUG 17667 --- [ctor-http-nio-2] o.s.c.g.handler.FilteringWebHandler      : Sorted gatewayFilterFactories: [OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.AdaptCachedBodyGlobalFilter@3ace6346}, order=-2147482648}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.GatewayMetricsFilter@55c1ced9}, order=-2147473648}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.NettyWriteResponseFilter@642c6461}, order=-1}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.ForwardPathFilter@10a907ec}, order=0}, OrderedGatewayFilter{delegate=org.springframework.cloud.gateway.filter.factory.RewritePathGatewayFilterFactory$$Lambda$731/539666337@c03010e, order=1}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.RouteToRequestUrlFilter@4e48462d}, order=10000}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.WebsocketRoutingFilter@59b492ec}, order=2147483646}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.NettyRoutingFilter@27ffd9f8}, order=2147483647}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.ForwardRoutingFilter@17216605}, order=2147483647}]
2019-02-04 16:37:48.875 TRACE 17667 --- [ctor-http-nio-2] o.s.w.s.adapter.HttpWebHandlerAdapter    : [80c75051] Completed 200 OK, headers={masked}
2019-02-04 16:37:48.893 TRACE 17667 --- [ctor-http-nio-2] org.springframework.web.HttpLogging      : [80c75051] Handling completed
2019-02-04 16:37:48.893 DEBUG 17667 --- [ctor-http-nio-2] r.n.http.server.HttpServerOperations     : [id: 0x80c75051, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:51352] Last HTTP response frame
2019-02-04 16:37:48.893 DEBUG 17667 --- [ctor-http-nio-2] r.n.http.server.HttpServerOperations     : [id: 0x80c75051, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:51352] No sendHeaders() called before complete, sending zero-length header
2019-02-04 16:37:48.894 DEBUG 17667 --- [ctor-http-nio-2] r.n.channel.ChannelOperationsHandler     : [id: 0x80c75051, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:51352] Writing object DefaultFullHttpResponse(decodeResult: success, version: HTTP/1.1, content: EmptyByteBufBE)
HTTP/1.1 200 OK
content-length: 0

shahbour commented 5 years ago

I am still trying to debug this and not getting anywhere, who is responsible to resolve the serviceId to IP and port. (I think this is done on spring gateway and not spring cloud kubernetes)

Currently, my application does not have any code, just a simple boot app with kubernetes discovery in class path with spring.gateway.discovery.locator.enabled: true

spencergibb commented 5 years ago

is spring-cloud-kubernetes-ribbon on the classpath?

shahbour commented 5 years ago

Yes, I do have ribbon (i tired it with and without) and still same result. I got 200 OK back for any service I try to access.

I feel it is a configuration error but can't catch it. I did update the project https://github.com/shahbour/gateway-demo with my latest test (very very simple project) .

2019-02-07 07:44:33.379  INFO 25720 --- [           main] c.t.gatewaydemo.GatewayDemoApplication   : Started GatewayDemoApplication in 14.259 seconds (JVM running for 19.43)
Available Services:
ace
auth
cdr-import
cdrimport
common
email-fetcher-buy
email-fetcher-sell
gateway
gateway-interprems
gateway-zonevoice
glusterfs
kubernetes
notify
rate-buy
rate-parser
rate-sell
rate-server-job
sonus
ui

2019-02-07 07:44:48.626 DEBUG 25720 --- [ctor-http-nio-2] io.netty.buffer.AbstractByteBuf          : -Dio.netty.buffer.checkAccessible: true
2019-02-07 07:44:48.626 DEBUG 25720 --- [ctor-http-nio-2] io.netty.buffer.AbstractByteBuf          : -Dio.netty.buffer.checkBounds: true
2019-02-07 07:44:48.631 DEBUG 25720 --- [ctor-http-nio-2] i.n.util.ResourceLeakDetectorFactory     : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@783e3d46
2019-02-07 07:44:48.707 DEBUG 25720 --- [ctor-http-nio-2] r.n.http.server.HttpServerOperations     : [id: 0x4e70d902, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:57297] New http connection, requesting read
2019-02-07 07:44:48.711 DEBUG 25720 --- [ctor-http-nio-2] reactor.netty.channel.BootstrapHandlers  : [id: 0x4e70d902, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:57297] Initialized pipeline DefaultChannelPipeline{(BootstrapHandlers$BootstrapInitializerHandler#0 = reactor.netty.channel.BootstrapHandlers$BootstrapInitializerHandler), (reactor.left.httpCodec = io.netty.handler.codec.http.HttpServerCodec), (reactor.left.httpTrafficHandler = reactor.netty.http.server.HttpTrafficHandler), (reactor.right.reactiveBridge = reactor.netty.channel.ChannelOperationsHandler)}
2019-02-07 07:44:48.726 DEBUG 25720 --- [ctor-http-nio-2] io.netty.util.Recycler                   : -Dio.netty.recycler.maxCapacityPerThread: 4096
2019-02-07 07:44:48.726 DEBUG 25720 --- [ctor-http-nio-2] io.netty.util.Recycler                   : -Dio.netty.recycler.maxSharedCapacityFactor: 2
2019-02-07 07:44:48.726 DEBUG 25720 --- [ctor-http-nio-2] io.netty.util.Recycler                   : -Dio.netty.recycler.linkCapacity: 16
2019-02-07 07:44:48.726 DEBUG 25720 --- [ctor-http-nio-2] io.netty.util.Recycler                   : -Dio.netty.recycler.ratio: 8
2019-02-07 07:44:48.762 DEBUG 25720 --- [ctor-http-nio-2] r.n.http.server.HttpServerOperations     : [id: 0x4e70d902, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:57297] Increasing pending responses, now 1
2019-02-07 07:44:48.777 DEBUG 25720 --- [ctor-http-nio-2] reactor.netty.http.server.HttpServer     : [id: 0x4e70d902, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:57297] Handler is being applied: org.springframework.http.server.reactive.ReactorHttpHandlerAdapter@3bae8272
2019-02-07 07:44:48.842 TRACE 25720 --- [ctor-http-nio-2] o.s.w.s.adapter.HttpWebHandlerAdapter    : [4e70d902] HTTP GET "/common/", headers={masked}
2019-02-07 07:44:49.437 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=ace}
2019-02-07 07:44:49.438 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"ace"},"name":"ace","namespace":"default"},"spec":{"ports":[{"port":80}],"selector":{"app":"ace"}}}
}
2019-02-07 07:44:49.439 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:49.453 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_ace applying {pattern=/ace/**} to Path
2019-02-07 07:44:49.500 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_ace applying filter {regexp=/ace/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:49.526 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_ace
2019-02-07 07:44:49.691 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=auth, management.context-path=uaa}
2019-02-07 07:44:49.692 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"auth","management.context-path":"uaa"},"name":"auth","namespace":"default"},"spec":{"ports":[{"port":9191,"protocol":"TCP","targetPort":9191}],"selector":{"app":"auth"},"type":"ClusterIP"}}
}
2019-02-07 07:44:49.692 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:49.692 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_auth applying {pattern=/auth/**} to Path
2019-02-07 07:44:49.695 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_auth applying filter {regexp=/auth/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:49.697 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_auth
2019-02-07 07:44:49.868 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=cdrimport}
2019-02-07 07:44:49.868 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"cdrimport"},"name":"cdr-import","namespace":"default"},"spec":{"ports":[{"name":"cdrimport","port":8080,"protocol":"TCP","targetPort":8080}],"selector":{"app":"cdrimport"},"sessionAffinity":"None","type":"ClusterIP"}}
}
2019-02-07 07:44:49.868 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {port.cdrimport=8080}
2019-02-07 07:44:49.870 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_cdr-import applying {pattern=/cdr-import/**} to Path
2019-02-07 07:44:49.873 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_cdr-import applying filter {regexp=/cdr-import/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:49.874 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_cdr-import
2019-02-07 07:44:50.035 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=cdrimport}
2019-02-07 07:44:50.035 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8080","prometheus.io/scrape":"true"},"labels":{"app":"cdrimport"},"name":"cdrimport","namespace":"default"},"spec":{"ports":[{"name":"cdrimport","port":8080,"protocol":"TCP","targetPort":8080}],"selector":{"app":"cdrimport"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8080, prometheus.io/scrape=true}
2019-02-07 07:44:50.036 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {port.cdrimport=8080}
2019-02-07 07:44:50.037 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_cdrimport applying {pattern=/cdrimport/**} to Path
2019-02-07 07:44:50.040 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_cdrimport applying filter {regexp=/cdrimport/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:50.041 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_cdrimport
2019-02-07 07:44:50.213 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=common}
2019-02-07 07:44:50.213 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8083","prometheus.io/scrape":"true"},"labels":{"app":"common"},"name":"common","namespace":"default"},"spec":{"ports":[{"port":8083,"protocol":"TCP","targetPort":8083}],"selector":{"app":"common"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8083, prometheus.io/scrape=true}
2019-02-07 07:44:50.213 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:50.214 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_common applying {pattern=/common/**} to Path
2019-02-07 07:44:50.215 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_common applying filter {regexp=/common/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:50.216 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_common
2019-02-07 07:44:50.391 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=email-fetcher-buy}
2019-02-07 07:44:50.391 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8091","prometheus.io/scrape":"true"},"labels":{"app":"email-fetcher-buy"},"name":"email-fetcher-buy","namespace":"default"},"spec":{"ports":[{"port":8091,"protocol":"TCP","targetPort":8091}],"selector":{"app":"email-fetcher-buy"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8091, prometheus.io/scrape=true}
2019-02-07 07:44:50.391 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:50.392 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_email-fetcher-buy applying {pattern=/email-fetcher-buy/**} to Path
2019-02-07 07:44:50.394 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_email-fetcher-buy applying filter {regexp=/email-fetcher-buy/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:50.395 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_email-fetcher-buy
2019-02-07 07:44:50.553 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=email-fetcher-sell}
2019-02-07 07:44:50.554 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8092","prometheus.io/scrape":"true"},"labels":{"app":"email-fetcher-sell"},"name":"email-fetcher-sell","namespace":"default"},"spec":{"ports":[{"port":8092,"protocol":"TCP","targetPort":8092}],"selector":{"app":"email-fetcher-sell"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8092, prometheus.io/scrape=true}
2019-02-07 07:44:50.554 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:50.556 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_email-fetcher-sell applying {pattern=/email-fetcher-sell/**} to Path
2019-02-07 07:44:50.558 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_email-fetcher-sell applying filter {regexp=/email-fetcher-sell/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:50.559 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_email-fetcher-sell
2019-02-07 07:44:50.719 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=gateway}
2019-02-07 07:44:50.719 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8080","prometheus.io/scrape":"true"},"labels":{"app":"gateway"},"name":"gateway","namespace":"default"},"spec":{"ports":[{"port":8080,"protocol":"TCP","targetPort":8080}],"selector":{"app":"gateway"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8080, prometheus.io/scrape=true}
2019-02-07 07:44:50.720 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:50.722 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway applying {pattern=/gateway/**} to Path
2019-02-07 07:44:50.723 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway applying filter {regexp=/gateway/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:50.724 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_gateway
2019-02-07 07:44:50.874 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=gateway-interprems}
2019-02-07 07:44:50.874 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"gateway-interprems"},"name":"gateway-interprems","namespace":"default"},"spec":{"ports":[{"port":8080,"protocol":"TCP","targetPort":8080}],"selector":{"app":"gateway-interprems"},"type":"ClusterIP"}}
}
2019-02-07 07:44:50.874 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:50.874 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway-interprems applying {pattern=/gateway-interprems/**} to Path
2019-02-07 07:44:50.876 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway-interprems applying filter {regexp=/gateway-interprems/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:50.877 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_gateway-interprems
2019-02-07 07:44:51.034 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=gateway-zonevoice}
2019-02-07 07:44:51.034 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"gateway-zonevoice"},"name":"gateway-zonevoice","namespace":"default"},"spec":{"ports":[{"port":8080,"protocol":"TCP","targetPort":8080}],"selector":{"app":"gateway-zonevoice"},"type":"ClusterIP"}}
}
2019-02-07 07:44:51.035 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:51.036 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway-zonevoice applying {pattern=/gateway-zonevoice/**} to Path
2019-02-07 07:44:51.041 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway-zonevoice applying filter {regexp=/gateway-zonevoice/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:51.042 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_gateway-zonevoice
2019-02-07 07:44:51.182 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {}
2019-02-07 07:44:51.182 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"name":"glusterfs","namespace":"default"},"spec":{"ports":[{"port":9091}]}}
}
2019-02-07 07:44:51.183 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:51.185 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_glusterfs applying {pattern=/glusterfs/**} to Path
2019-02-07 07:44:51.191 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_glusterfs applying filter {regexp=/glusterfs/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:51.198 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_glusterfs
2019-02-07 07:44:51.377 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {component=apiserver, provider=kubernetes}
2019-02-07 07:44:51.377 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {}
2019-02-07 07:44:51.377 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {port.https=6443}
2019-02-07 07:44:51.378 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_kubernetes applying {pattern=/kubernetes/**} to Path
2019-02-07 07:44:51.380 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_kubernetes applying filter {regexp=/kubernetes/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:51.381 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_kubernetes
2019-02-07 07:44:51.550 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=notify}
2019-02-07 07:44:51.550 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"9011","prometheus.io/scrape":"true"},"labels":{"app":"notify"},"name":"notify","namespace":"default"},"spec":{"ports":[{"port":9011,"protocol":"TCP","targetPort":9011}],"selector":{"app":"notify"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=9011, prometheus.io/scrape=true}
2019-02-07 07:44:51.551 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:51.554 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_notify applying {pattern=/notify/**} to Path
2019-02-07 07:44:51.556 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_notify applying filter {regexp=/notify/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:51.557 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_notify
2019-02-07 07:44:51.735 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=rate-buy}
2019-02-07 07:44:51.735 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8089","prometheus.io/scrape":"true"},"labels":{"app":"rate-buy"},"name":"rate-buy","namespace":"default"},"spec":{"ports":[{"port":8089,"protocol":"TCP","targetPort":8089}],"selector":{"app":"rate-buy"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8089, prometheus.io/scrape=true}
2019-02-07 07:44:51.735 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:51.736 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-buy applying {pattern=/rate-buy/**} to Path
2019-02-07 07:44:51.737 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-buy applying filter {regexp=/rate-buy/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:51.738 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_rate-buy
2019-02-07 07:44:51.897 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=rate-parser}
2019-02-07 07:44:51.897 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8087","prometheus.io/scrape":"true"},"labels":{"app":"rate-parser"},"name":"rate-parser","namespace":"default"},"spec":{"ports":[{"port":8087,"protocol":"TCP","targetPort":8087}],"selector":{"app":"rate-parser"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8087, prometheus.io/scrape=true}
2019-02-07 07:44:51.897 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:51.898 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-parser applying {pattern=/rate-parser/**} to Path
2019-02-07 07:44:51.903 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-parser applying filter {regexp=/rate-parser/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:51.904 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_rate-parser
2019-02-07 07:44:52.171 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=rate-sell}
2019-02-07 07:44:52.171 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8084","prometheus.io/scrape":"true"},"labels":{"app":"rate-sell"},"name":"rate-sell","namespace":"default"},"spec":{"ports":[{"port":8084,"protocol":"TCP","targetPort":8084}],"selector":{"app":"rate-sell"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8084, prometheus.io/scrape=true}
2019-02-07 07:44:52.171 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:52.171 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-sell applying {pattern=/rate-sell/**} to Path
2019-02-07 07:44:52.174 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-sell applying filter {regexp=/rate-sell/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:52.176 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_rate-sell
2019-02-07 07:44:52.330 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=rate-server-job}
2019-02-07 07:44:52.330 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8086","prometheus.io/scrape":"true"},"labels":{"app":"rate-server-job"},"name":"rate-server-job","namespace":"default"},"spec":{"ports":[{"port":8086,"protocol":"TCP","targetPort":8086}],"selector":{"app":"rate-server-job"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8086, prometheus.io/scrape=true}
2019-02-07 07:44:52.330 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:52.330 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-server-job applying {pattern=/rate-server-job/**} to Path
2019-02-07 07:44:52.333 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-server-job applying filter {regexp=/rate-server-job/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:52.335 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_rate-server-job
2019-02-07 07:44:52.485 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=sonus}
2019-02-07 07:44:52.485 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"sonus"},"name":"sonus","namespace":"default"},"spec":{"ports":[{"port":9010,"protocol":"TCP","targetPort":9010}],"selector":{"app":"sonus"},"type":"ClusterIP"}}
}
2019-02-07 07:44:52.485 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:52.485 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_sonus applying {pattern=/sonus/**} to Path
2019-02-07 07:44:52.486 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_sonus applying filter {regexp=/sonus/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:52.487 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_sonus
2019-02-07 07:44:52.650 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=ui, management.context-path=ui}
2019-02-07 07:44:52.650 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"ui","management.context-path":"ui"},"name":"ui","namespace":"default"},"spec":{"ports":[{"port":8085,"protocol":"TCP","targetPort":8085}],"selector":{"app":"ui"},"type":"ClusterIP"}}
}
2019-02-07 07:44:52.650 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:52.651 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_ui applying {pattern=/ui/**} to Path
2019-02-07 07:44:52.652 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_ui applying filter {regexp=/ui/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:52.653 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_ui
2019-02-07 07:44:52.904 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=ace}
2019-02-07 07:44:52.905 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"ace"},"name":"ace","namespace":"default"},"spec":{"ports":[{"port":80}],"selector":{"app":"ace"}}}
}
2019-02-07 07:44:52.905 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:52.905 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_ace applying {pattern=/ace/**} to Path
2019-02-07 07:44:52.907 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_ace applying filter {regexp=/ace/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:52.907 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_ace
2019-02-07 07:44:53.077 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=auth, management.context-path=uaa}
2019-02-07 07:44:53.077 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"auth","management.context-path":"uaa"},"name":"auth","namespace":"default"},"spec":{"ports":[{"port":9191,"protocol":"TCP","targetPort":9191}],"selector":{"app":"auth"},"type":"ClusterIP"}}
}
2019-02-07 07:44:53.077 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:53.077 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_auth applying {pattern=/auth/**} to Path
2019-02-07 07:44:53.079 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_auth applying filter {regexp=/auth/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:53.080 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_auth
2019-02-07 07:44:53.234 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=cdrimport}
2019-02-07 07:44:53.235 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"cdrimport"},"name":"cdr-import","namespace":"default"},"spec":{"ports":[{"name":"cdrimport","port":8080,"protocol":"TCP","targetPort":8080}],"selector":{"app":"cdrimport"},"sessionAffinity":"None","type":"ClusterIP"}}
}
2019-02-07 07:44:53.235 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {port.cdrimport=8080}
2019-02-07 07:44:53.235 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_cdr-import applying {pattern=/cdr-import/**} to Path
2019-02-07 07:44:53.237 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_cdr-import applying filter {regexp=/cdr-import/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:53.237 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_cdr-import
2019-02-07 07:44:53.397 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=cdrimport}
2019-02-07 07:44:53.398 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8080","prometheus.io/scrape":"true"},"labels":{"app":"cdrimport"},"name":"cdrimport","namespace":"default"},"spec":{"ports":[{"name":"cdrimport","port":8080,"protocol":"TCP","targetPort":8080}],"selector":{"app":"cdrimport"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8080, prometheus.io/scrape=true}
2019-02-07 07:44:53.399 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {port.cdrimport=8080}
2019-02-07 07:44:53.400 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_cdrimport applying {pattern=/cdrimport/**} to Path
2019-02-07 07:44:53.402 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_cdrimport applying filter {regexp=/cdrimport/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:53.403 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_cdrimport
2019-02-07 07:44:53.567 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=common}
2019-02-07 07:44:53.567 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8083","prometheus.io/scrape":"true"},"labels":{"app":"common"},"name":"common","namespace":"default"},"spec":{"ports":[{"port":8083,"protocol":"TCP","targetPort":8083}],"selector":{"app":"common"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8083, prometheus.io/scrape=true}
2019-02-07 07:44:53.567 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:53.567 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_common applying {pattern=/common/**} to Path
2019-02-07 07:44:53.569 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_common applying filter {regexp=/common/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:53.569 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_common
2019-02-07 07:44:53.728 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=email-fetcher-buy}
2019-02-07 07:44:53.728 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8091","prometheus.io/scrape":"true"},"labels":{"app":"email-fetcher-buy"},"name":"email-fetcher-buy","namespace":"default"},"spec":{"ports":[{"port":8091,"protocol":"TCP","targetPort":8091}],"selector":{"app":"email-fetcher-buy"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8091, prometheus.io/scrape=true}
2019-02-07 07:44:53.728 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:53.728 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_email-fetcher-buy applying {pattern=/email-fetcher-buy/**} to Path
2019-02-07 07:44:53.730 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_email-fetcher-buy applying filter {regexp=/email-fetcher-buy/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:53.731 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_email-fetcher-buy
2019-02-07 07:44:53.896 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=email-fetcher-sell}
2019-02-07 07:44:53.896 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8092","prometheus.io/scrape":"true"},"labels":{"app":"email-fetcher-sell"},"name":"email-fetcher-sell","namespace":"default"},"spec":{"ports":[{"port":8092,"protocol":"TCP","targetPort":8092}],"selector":{"app":"email-fetcher-sell"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8092, prometheus.io/scrape=true}
2019-02-07 07:44:53.896 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:53.897 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_email-fetcher-sell applying {pattern=/email-fetcher-sell/**} to Path
2019-02-07 07:44:53.899 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_email-fetcher-sell applying filter {regexp=/email-fetcher-sell/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:53.903 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_email-fetcher-sell
2019-02-07 07:44:54.073 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=gateway}
2019-02-07 07:44:54.073 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8080","prometheus.io/scrape":"true"},"labels":{"app":"gateway"},"name":"gateway","namespace":"default"},"spec":{"ports":[{"port":8080,"protocol":"TCP","targetPort":8080}],"selector":{"app":"gateway"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8080, prometheus.io/scrape=true}
2019-02-07 07:44:54.073 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:54.074 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway applying {pattern=/gateway/**} to Path
2019-02-07 07:44:54.075 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway applying filter {regexp=/gateway/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:54.075 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_gateway
2019-02-07 07:44:54.233 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=gateway-interprems}
2019-02-07 07:44:54.233 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"gateway-interprems"},"name":"gateway-interprems","namespace":"default"},"spec":{"ports":[{"port":8080,"protocol":"TCP","targetPort":8080}],"selector":{"app":"gateway-interprems"},"type":"ClusterIP"}}
}
2019-02-07 07:44:54.234 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:54.234 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway-interprems applying {pattern=/gateway-interprems/**} to Path
2019-02-07 07:44:54.235 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway-interprems applying filter {regexp=/gateway-interprems/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:54.236 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_gateway-interprems
2019-02-07 07:44:54.391 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=gateway-zonevoice}
2019-02-07 07:44:54.391 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"gateway-zonevoice"},"name":"gateway-zonevoice","namespace":"default"},"spec":{"ports":[{"port":8080,"protocol":"TCP","targetPort":8080}],"selector":{"app":"gateway-zonevoice"},"type":"ClusterIP"}}
}
2019-02-07 07:44:54.391 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:54.391 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway-zonevoice applying {pattern=/gateway-zonevoice/**} to Path
2019-02-07 07:44:54.392 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_gateway-zonevoice applying filter {regexp=/gateway-zonevoice/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:54.393 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_gateway-zonevoice
2019-02-07 07:44:54.562 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {}
2019-02-07 07:44:54.562 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"name":"glusterfs","namespace":"default"},"spec":{"ports":[{"port":9091}]}}
}
2019-02-07 07:44:54.562 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:54.563 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_glusterfs applying {pattern=/glusterfs/**} to Path
2019-02-07 07:44:54.565 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_glusterfs applying filter {regexp=/glusterfs/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:54.568 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_glusterfs
2019-02-07 07:44:54.730 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {component=apiserver, provider=kubernetes}
2019-02-07 07:44:54.730 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {}
2019-02-07 07:44:54.730 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {port.https=6443}
2019-02-07 07:44:54.730 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_kubernetes applying {pattern=/kubernetes/**} to Path
2019-02-07 07:44:54.735 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_kubernetes applying filter {regexp=/kubernetes/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:54.736 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_kubernetes
2019-02-07 07:44:54.896 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=notify}
2019-02-07 07:44:54.897 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"9011","prometheus.io/scrape":"true"},"labels":{"app":"notify"},"name":"notify","namespace":"default"},"spec":{"ports":[{"port":9011,"protocol":"TCP","targetPort":9011}],"selector":{"app":"notify"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=9011, prometheus.io/scrape=true}
2019-02-07 07:44:54.897 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:54.898 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_notify applying {pattern=/notify/**} to Path
2019-02-07 07:44:54.903 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_notify applying filter {regexp=/notify/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:54.904 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_notify
2019-02-07 07:44:55.074 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=rate-buy}
2019-02-07 07:44:55.074 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8089","prometheus.io/scrape":"true"},"labels":{"app":"rate-buy"},"name":"rate-buy","namespace":"default"},"spec":{"ports":[{"port":8089,"protocol":"TCP","targetPort":8089}],"selector":{"app":"rate-buy"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8089, prometheus.io/scrape=true}
2019-02-07 07:44:55.075 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:55.075 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-buy applying {pattern=/rate-buy/**} to Path
2019-02-07 07:44:55.076 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-buy applying filter {regexp=/rate-buy/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:55.077 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_rate-buy
2019-02-07 07:44:55.222 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=rate-parser}
2019-02-07 07:44:55.223 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8087","prometheus.io/scrape":"true"},"labels":{"app":"rate-parser"},"name":"rate-parser","namespace":"default"},"spec":{"ports":[{"port":8087,"protocol":"TCP","targetPort":8087}],"selector":{"app":"rate-parser"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8087, prometheus.io/scrape=true}
2019-02-07 07:44:55.223 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:55.223 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-parser applying {pattern=/rate-parser/**} to Path
2019-02-07 07:44:55.224 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-parser applying filter {regexp=/rate-parser/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:55.225 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_rate-parser
2019-02-07 07:44:55.370 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=rate-sell}
2019-02-07 07:44:55.370 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8084","prometheus.io/scrape":"true"},"labels":{"app":"rate-sell"},"name":"rate-sell","namespace":"default"},"spec":{"ports":[{"port":8084,"protocol":"TCP","targetPort":8084}],"selector":{"app":"rate-sell"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8084, prometheus.io/scrape=true}
2019-02-07 07:44:55.370 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:55.371 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-sell applying {pattern=/rate-sell/**} to Path
2019-02-07 07:44:55.372 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-sell applying filter {regexp=/rate-sell/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:55.373 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_rate-sell
2019-02-07 07:44:55.522 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=rate-server-job}
2019-02-07 07:44:55.522 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{"prometheus.io/path":"/actuator/prometheus","prometheus.io/port":"8086","prometheus.io/scrape":"true"},"labels":{"app":"rate-server-job"},"name":"rate-server-job","namespace":"default"},"spec":{"ports":[{"port":8086,"protocol":"TCP","targetPort":8086}],"selector":{"app":"rate-server-job"},"type":"ClusterIP"}}
, prometheus.io/path=/actuator/prometheus, prometheus.io/port=8086, prometheus.io/scrape=true}
2019-02-07 07:44:55.522 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:55.522 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-server-job applying {pattern=/rate-server-job/**} to Path
2019-02-07 07:44:55.524 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_rate-server-job applying filter {regexp=/rate-server-job/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:55.524 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_rate-server-job
2019-02-07 07:44:55.695 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=sonus}
2019-02-07 07:44:55.695 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"sonus"},"name":"sonus","namespace":"default"},"spec":{"ports":[{"port":9010,"protocol":"TCP","targetPort":9010}],"selector":{"app":"sonus"},"type":"ClusterIP"}}
}
2019-02-07 07:44:55.695 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:55.696 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_sonus applying {pattern=/sonus/**} to Path
2019-02-07 07:44:55.697 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_sonus applying filter {regexp=/sonus/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:55.698 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_sonus
2019-02-07 07:44:55.847 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=ui, management.context-path=ui}
2019-02-07 07:44:55.847 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"ui","management.context-path":"ui"},"name":"ui","namespace":"default"},"spec":{"ports":[{"port":8085,"protocol":"TCP","targetPort":8085}],"selector":{"app":"ui"},"type":"ClusterIP"}}
}
2019-02-07 07:44:55.848 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {}
2019-02-07 07:44:55.850 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_ui applying {pattern=/ui/**} to Path
2019-02-07 07:44:55.852 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_ui applying filter {regexp=/ui/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-07 07:44:55.853 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_ui
2019-02-07 07:44:55.876 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.h.RoutePredicateHandlerMapping   : Route matched: CompositeDiscoveryClient_common
2019-02-07 07:44:55.878 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.h.RoutePredicateHandlerMapping   : Mapping [Exchange: GET http://localhost:8080/common/] to Route{id='CompositeDiscoveryClient_common', uri=lb://common, order=0, predicate=org.springframework.cloud.gateway.support.ServerWebExchangeUtils$$Lambda$682/1765611431@2d9f7f36, gatewayFilters=[OrderedGatewayFilter{delegate=org.springframework.cloud.gateway.filter.factory.RewritePathGatewayFilterFactory$$Lambda$684/211420559@3aa7473, order=1}]}
2019-02-07 07:44:55.879 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.h.RoutePredicateHandlerMapping   : [4e70d902] Mapped to org.springframework.cloud.gateway.handler.FilteringWebHandler@16dafba1
2019-02-07 07:44:55.885 DEBUG 25720 --- [ctor-http-nio-2] o.s.c.g.handler.FilteringWebHandler      : Sorted gatewayFilterFactories: [OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.AdaptCachedBodyGlobalFilter@2ce6c6ec}, order=-2147482648}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.GatewayMetricsFilter@1672fe87}, order=-2147473648}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.NettyWriteResponseFilter@5c45d770}, order=-1}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.ForwardPathFilter@6676f6a0}, order=0}, OrderedGatewayFilter{delegate=org.springframework.cloud.gateway.filter.factory.RewritePathGatewayFilterFactory$$Lambda$684/211420559@3aa7473, order=1}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.RouteToRequestUrlFilter@1bae316d}, order=10000}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.WebsocketRoutingFilter@7cbd9d24}, order=2147483646}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.NettyRoutingFilter@5b7a8434}, order=2147483647}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.ForwardRoutingFilter@147a5d08}, order=2147483647}]
2019-02-07 07:44:55.962 TRACE 25720 --- [ctor-http-nio-2] o.s.w.s.adapter.HttpWebHandlerAdapter    : [4e70d902] Completed 200 OK, headers={masked}
2019-02-07 07:44:55.975 TRACE 25720 --- [ctor-http-nio-2] org.springframework.web.HttpLogging      : [4e70d902] Handling completed
2019-02-07 07:44:55.975 DEBUG 25720 --- [ctor-http-nio-2] r.n.http.server.HttpServerOperations     : [id: 0x4e70d902, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:57297] Last HTTP response frame
2019-02-07 07:44:55.975 DEBUG 25720 --- [ctor-http-nio-2] r.n.http.server.HttpServerOperations     : [id: 0x4e70d902, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:57297] No sendHeaders() called before complete, sending zero-length header
2019-02-07 07:44:55.976 DEBUG 25720 --- [ctor-http-nio-2] r.n.channel.ChannelOperationsHandler     : [id: 0x4e70d902, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:57297] Writing object DefaultFullHttpResponse(decodeResult: success, version: HTTP/1.1, content: EmptyByteBufBE)
HTTP/1.1 200 OK
content-length: 0
2019-02-07 07:44:55.987 DEBUG 25720 --- [ctor-http-nio-2] r.n.http.server.HttpServerOperations     : [id: 0x4e70d902, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:57297] Decreasing pending responses, now 0
2019-02-07 07:44:55.992 DEBUG 25720 --- [ctor-http-nio-2] r.n.channel.ChannelOperationsHandler     : [id: 0x4e70d902, L:/0:0:0:0:0:0:0:1:8080 - R:/0:0:0:0:0:0:0:1:57297] No ChannelOperation attached. Dropping: EmptyLastHttpContent

shahbour commented 5 years ago

Is there any working sample gateway + kubernetes , using spring boot 2.1 ? I did a test on different servers and different clusters and always the same result, and there is nothing in the code to change

shahbour commented 5 years ago

ok finally i got some logic .

1- I was trying the run the application at my machine , all the tests above are done like that , so now i deployed a pod for the gateway and it did resolve the service ip at least. Can you please confirm if this is the case because when using Zuul i was able to do testing from my machine directly .

I was able to change this and work directly from my machine by changing the url-expression: "'http://' + serviceId to url-expression: "'http://' + host + ':' + port"

~~2- Even though it did resolve the common service name to the service ip it did no honor the port it did default to port 80 where my service run at port 8083~~

this was also resolved by adding the port to the url-expression like url-expression: "'http://'+serviceId + ':' + port"

Based on the above i think the url-expression should change based on the kubernetes profile so if we are working on local machine it do default to http://' + host + ':' + port" and if we are inside the cluster it do use http://serviceId

Also port is not being honored in the current default url-expresision so I also think the default should include port .

These logs before the port fix.

2019-02-08 07:28:51.584 DEBUG 1 --- [or-http-epoll-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding label metadata: {app=common}
2019-02-08 07:28:51.584 DEBUG 1 --- [or-http-epoll-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding annotation metadata: {kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"v1","kind":"Service","metadata":{"annotations":{},"labels":{"app":"common"},"name":"common","namespace":"default"},"spec":{"ports":[{"port":8083}],"selector":{"app":"common"}}}
}
2019-02-08 07:28:51.584 DEBUG 1 --- [or-http-epoll-2] o.s.c.k.d.KubernetesDiscoveryClient      : Adding port metadata: {port.common-port=8083}
2019-02-08 07:28:51.585 DEBUG 1 --- [or-http-epoll-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_common applying {pattern=/common/**} to Path
2019-02-08 07:28:51.587 DEBUG 1 --- [or-http-epoll-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition CompositeDiscoveryClient_common applying filter {regexp=/common/(?<remaining>.*), replacement=/${remaining}} to RewritePath
2019-02-08 07:28:51.588 DEBUG 1 --- [or-http-epoll-2] o.s.c.g.r.RouteDefinitionRouteLocator    : RouteDefinition matched: CompositeDiscoveryClient_common

2019-02-08 07:28:52.216 DEBUG 1 --- [or-http-epoll-2] o.s.c.g.h.RoutePredicateHandlerMapping   : Mapping [Exchange: GET http://10.44.0.109:8080/common/] to Route{id='CompositeDiscoveryClient_common', uri=http://common:80, order=0, predicate=org.springframework.cloud.gateway.support.ServerWebExchangeUtils$$Lambda$680/1742773867@6d3ce533, gatewayFilters=[OrderedGatewayFilter{delegate=org.springframework.cloud.gateway.filter.factory.RewritePathGatewayFilterFactory$$Lambda$682/482634726@525611d8, order=1}]}
2019-02-08 07:28:52.216 DEBUG 1 --- [or-http-epoll-2] o.s.c.g.h.RoutePredicateHandlerMapping   : [07504f8e] Mapped to org.springframework.cloud.gateway.handler.FilteringWebHandler@18957ac2
2019-02-08 07:28:52.217 DEBUG 1 --- [or-http-epoll-2] o.s.c.g.handler.FilteringWebHandler      : Sorted gatewayFilterFactories: [OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.AdaptCachedBodyGlobalFilter@386f0da3}, order=-2147482648}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.GatewayMetricsFilter@6e4566f1}, order=-2147473648}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.NettyWriteResponseFilter@22356acd}, order=-1}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.ForwardPathFilter@3d1848cc}, order=0}, OrderedGatewayFilter{delegate=org.springframework.cloud.gateway.filter.factory.RewritePathGatewayFilterFactory$$Lambda$682/482634726@525611d8, order=1}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.RouteToRequestUrlFilter@39655d3e}, order=10000}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.WebsocketRoutingFilter@7dda48d9}, order=2147483646}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.NettyRoutingFilter@2e1ef60}, order=2147483647}, OrderedGatewayFilter{delegate=GatewayFilterAdapter{delegate=org.springframework.cloud.gateway.filter.ForwardRoutingFilter@34f22f9d}, order=2147483647}]
2019-02-08 07:28:52.378 DEBUG 1 --- [or-http-epoll-2] r.n.resources.PooledConnectionProvider   : Creating new client pool [proxy] for common:80
2019-02-08 07:28:52.384 DEBUG 1 --- [or-http-epoll-2] r.n.resources.PooledConnectionProvider   : [id: 0xc3c7a051] Created new pooled channel, now 0 active connections and 1 inactive connections
2019-02-08 07:28:52.389 DEBUG 1 --- [or-http-epoll-2] reactor.netty.channel.BootstrapHandlers  : [id: 0xc3c7a051] Initialized pipeline DefaultChannelPipeline{(BootstrapHandlers$BootstrapInitializerHandler#0 = reactor.netty.channel.BootstrapHandlers$BootstrapInitializerHandler), (SimpleChannelPool$1#0 = io.netty.channel.pool.SimpleChannelPool$1), (reactor.left.httpCodec = io.netty.handler.codec.http.HttpClientCodec), (reactor.right.reactiveBridge = reactor.netty.channel.ChannelOperationsHandler)}
2019-02-08 07:28:52.514 TRACE 1 --- [or-http-epoll-1] o.s.w.r.function.server.RouterFunctions  : [07504f8e] Matched org.springframework.boot.autoconfigure.web.reactive.error.DefaultErrorWebExceptionHandler$$Lambda$734/1055500901@33629b1f
2019-02-08 07:28:52.607 ERROR 1 --- [or-http-epoll-1] o.s.w.s.adapter.HttpWebHandlerAdapter    : [07504f8e] 500 Server Error for HTTP GET "/common/"
io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Host is unreachable: common/10.100.135.181:80
    at io.netty.channel.unix.Errors.throwConnectException(Errors.java:112) ~[netty-transport-native-unix-common-4.1.31.Final.jar!/:4.1.31.Final]
    at io.netty.channel.unix.Socket.finishConnect(Socket.java:269) ~[netty-transport-native-unix-common-4.1.31.Final.jar!/:4.1.31.Final]
    at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:665) ~[netty-transport-native-epoll-4.1.31.Final-linux-x86_64.jar!/:4.1.31.Final]
    at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:642) ~[netty-transport-native-epoll-4.1.31.Final-linux-x86_64.jar!/:4.1.31.Final]
    at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:522) ~[netty-transport-native-epoll-4.1.31.Final-linux-x86_64.jar!/:4.1.31.Final]
    at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:423) ~[netty-transport-native-epoll-4.1.31.Final-linux-x86_64.jar!/:4.1.31.Final]
    at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:330) ~[netty-transport-native-epoll-4.1.31.Final-linux-x86_64.jar!/:4.1.31.Final]
    at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897) ~[netty-common-4.1.31.Final.jar!/:4.1.31.Final]
    at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_191]
Caused by: java.net.ConnectException: finishConnect(..) failed: Host is unreachable
    ... 9 common frames omitted
2019-02-08 07:28:52.640 TRACE 1 --- [or-http-epoll-1] org.springframework.web.HttpLogging      : [07504f8e] Handling completed
2019-02-08 07:28:52.645 DEBUG 1 --- [or-http-epoll-1] r.n.http.server.HttpServerOperations     : [id: 0x07504f8e, L:/10.44.0.109:8080 - R:/10.32.0.1:54646] Last HTTP response frame
2019-02-08 07:28:52.645 DEBUG 1 --- [or-http-epoll-1] r.n.http.server.HttpServerOperations     : [id: 0x07504f8e, L:/10.44.0.109:8080 - R:/10.32.0.1:54646] No sendHeaders() called before complete, sending zero-length header
2019-02-08 07:28:52.652 DEBUG 1 --- [or-http-epoll-2] r.n.channel.ChannelOperationsHandler     : [id: 0x07504f8e, L:/10.44.0.109:8080 - R:/10.32.0.1:54646] Writing object DefaultFullHttpResponse(decodeResult: success, version: HTTP/1.1, content: EmptyByteBufBE)
HTTP/1.1 500 Internal Server Error
content-length: 0

spencergibb commented 5 years ago

The url expression for gateway is to use ribbon to load balance and specifically doesn't have a port since that comes from discovery later.

I know @ryanjbaxter has a sample of this working, so I'm going to close this.

ryanjbaxter commented 5 years ago

I have a gateway working with service discovery and load balancing working on both minikube and GKE. I dont really understand what you are saying about the host and port

shahbour commented 5 years ago

Can you please share it so u can test .

Did you test the application running on local computer and trying to connect to services on minikube or cluster ? As developer u need to debug and interacted with running services

Are your services running on port other than port 80 ?

On Mon, Feb 11, 2019, 7:41 PM Ryan Baxter <notifications@github.com wrote:

I have a gateway working with service discovery and load balancing working on both minikube and GKE. I dont really understand what you are saying about the host and port

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/spring-cloud/spring-cloud-kubernetes/issues/324#issuecomment-462422231, or mute the thread https://github.com/notifications/unsubscribe-auth/ABzk-OSLcc-ODQkzILIG9hypPiW3PX8Gks5vMatFgaJpZM4ahArH .

ryanjbaxter commented 5 years ago

Did you test the application running on local computer and trying to connect to services on minikube or cluster ? As developer u need to debug and interacted with running services

Do you mean running the app from your ide while using service discovery from a local kubernetes cluster?

shahbour commented 5 years ago

Yes exactly

On Mon, Feb 11, 2019, 7:58 PM Ryan Baxter <notifications@github.com wrote:

Did you test the application running on local computer and trying to connect to services on minikube or cluster ? As developer u need to debug and interacted with running services

Do you mean running the app from your ide while using service discovery from a local kubernetes cluster?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/spring-cloud/spring-cloud-kubernetes/issues/324#issuecomment-462428404, or mute the thread https://github.com/notifications/unsubscribe-auth/ABzk-F_GV0s-3M8cvzKYJwbJylL3OQYJks5vMa86gaJpZM4ahArH .

ryanjbaxter commented 5 years ago

This is something I am working on figuring out with @salaboy. If that what this issue is about that was not clear.

shahbour commented 5 years ago

When I started I did not know that the problem is because I am testing from ide. (I am moving from zuul so I thought that was done)

One more thing have you tried to test a service running on port other than 80?

Thanks

On Mon, Feb 11, 2019, 8:02 PM Ryan Baxter <notifications@github.com wrote:

This is something I am working on figuring out with @salaboy https://github.com/salaboy. If that what this issue is about that was not clear.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/spring-cloud/spring-cloud-kubernetes/issues/324#issuecomment-462429957, or mute the thread https://github.com/notifications/unsubscribe-auth/ABzk-JU_GtExW0z1Ig1avo2A7ByXlWKDks5vMbA8gaJpZM4ahArH .

ryanjbaxter commented 5 years ago

Yeah all my services are running on ports other than 80

shahbour commented 5 years ago

Ok can you share a sample if possible , just the gateway or look at my sample , before last commit when I changed the URL.

On Mon, Feb 11, 2019, 8:27 PM Ryan Baxter <notifications@github.com wrote:

Yeah all my services are running on ports other than 80

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/spring-cloud/spring-cloud-kubernetes/issues/324#issuecomment-462439021, or mute the thread https://github.com/notifications/unsubscribe-auth/ABzk-J2xtnvqaGPoW6BJOV9MOURhwfN5ks5vMbYbgaJpZM4ahArH .

ryanjbaxter commented 5 years ago

Check out this branch https://github.com/ryanjbaxter/chaos-monkey-spring-boot-demo/tree/spring-cloud-kubernetes

shahbour commented 5 years ago

hello @ryanjbaxter , I did test the gateway and it is working. I was missing the Netflix ribbon dependency adding kubernetes ribbon is not enough.

        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-kubernetes</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-ribbon</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-kubernetes-ribbon</artifactId>
        </dependency>

Now Gateway is looking for endpoints for the service i am trying to access .

Note : I did test it from IDE and it just worked

salaboy commented 5 years ago

@shahbour @ryanjbaxter for some reason that is set to option, which I believe should be ok. but we might need to improve our docs.

ryanjbaxter commented 5 years ago

@shahbour I believe this is what @spencergibb said here originally https://github.com/spring-cloud/spring-cloud-kubernetes/issues/324#issuecomment-461131141

In any case glad you got it working!

shahbour commented 5 years ago

@ryanjbaxter I did add spring-cloud-starter-kubernetes-ribbon but that did not include spring-cloud-starter-netflix-ribbon which is needed, so i think we should mention that in the document some where .

sorry for commenting on closed issue

ryanjbaxter commented 5 years ago

Ah ok. spring-cloud-starter-netflix-ribbon isnt included in spring-cloud-starter-kubernetes-ribbon we should fix that!

ryanjbaxter commented 5 years ago

@shahbour see https://github.com/spring-cloud/spring-cloud-kubernetes/commit/d2c5b48011a78aec9396148bdebfc194876a664b

shahbour commented 5 years ago

Looks good, just on spring-cloud-kubernetes-ribbon/pom.xml it is found as optional may be there it should not be optional.

ryanjbaxter commented 5 years ago

No that is the point of using the starter. You will not be adding spring-cloud-kubernetes-ribbon to your classpath you will be adding the starter.

shahbour commented 5 years ago

Maybe we should open a new thread for this, but would not it be better if we just call the kuberentes service (ip:port) and it handles the load balancing at server side instead of using ribbon and balance at client side ?

By changing url-expression to "'http://' + host + ':' + port" i was able to achieve that as in comment#461717038

ryanjbaxter commented 5 years ago

That is a different issue entirely, please open a separate issue

spring-cloud / spring-cloud-kubernetes

Cloud Gateway with Kubernetes not working #324