search

spring-cloud / spring-cloud-netflix

Integration with Netflix OSS components
http://cloud.spring.io/spring-cloud-netflix/
Apache License 2.0
4.87k stars 2.44k forks source link

first call to Zuul fails with Connection reset when executed on server #2326

Closed vimal-raz closed 6 years ago

vimal-raz commented 7 years ago

If we run the Zuul proxy for about 15-30 min without making any calls, it will fail the first call with an HTTP 500 error (Connection reset when executed on server )zuu. After that, all subsequent calls work properly.

Config:

hystrix:
  command:
    default:
      execution:
        timeout:
          enabled: false

ribbon:
  ReadTimeout: 10000

Versions:

Full log: First call fails and second works https://gist.github.com/vimal-raz/9ddc8113e7513b5ab54d2533b1cad0cb

   2017-09-27T12:27:36.87-0400 [APP/PROC/WEB/0] OUT 2017-09-27 16:27:36.871 DEBUG 14 --- [nio-8080-exec-2] org.apache.http.wire                     : http-outgoing-30 << "[read] I/O error: Connection reset"

   2017-09-27T12:27:36.87-0400 [APP/PROC/WEB/0] OUT 2017-09-27 16:27:36.871 DEBUG 14 --- [nio-8080-exec-2] h.i.c.DefaultManagedHttpClientConnection : http-outgoing-30: Close connection
   2017-09-27T12:27:36.87-0400 [APP/PROC/WEB/0] OUT 2017-09-27 16:27:36.871 DEBUG 14 --- [nio-8080-exec-2] h.i.c.DefaultManagedHttpClientConnection : http-outgoing-30: Shutdown connection
   2017-09-27T12:27:36.87-0400 [APP/PROC/WEB/0] OUT 2017-09-27 16:27:36.871 DEBUG 14 --- [nio-8080-exec-2] o.a.http.impl.execchain.MainClientExec   : Connection discarded
   2017-09-27T12:27:36.87-0400 [APP/PROC/WEB/0] OUT 2017-09-27 16:27:36.871 DEBUG 14 --- [nio-8080-exec-2] h.i.c.PoolingHttpClientConnectionManager : Connection released: [id: 30][route: {s}->https://mbdealerservice.apps.dev.us-east-1.nafta-ow.com:443][total kept alive: 0; route allocated: 0 of 50; total allocated: 0 of 200]

  2017-09-27T12:27:36.87-0400 [APP/PROC/WEB/0] OUT 2017-09-27 16:27:36.871 DEBUG 14 --- [nio-8080-exec-2] c.n.l.reactive.LoadBalancerCommand       : Got error java.net.SocketException: Connection reset when executed on server XXXXXXXXXXXXXX:d10d793e-8293-438d-78c4-20360c35c3a5
2017-09-27T12:27:36.87-0400 [APP/PROC/WEB/0] OUT com.netflix.client.ClientException: null
   2017-09-27T12:27:36.87-0400 [APP/PROC/WEB/0] OUT 2017-09-27 16:27:36.874 DEBUG 14 --- [nio-8080-exec-2] com.netflix.hystrix.AbstractCommand      : Error executing HystrixCommand.run(). Proceeding to fallback logic ...
vimal-raz commented 7 years ago

It is deployed in Pivotal Cloud Foundry

spencergibb commented 7 years ago

Please learn how to properly format code and logs. What version of spring cloud are you using? See #1334

vimal-raz commented 7 years ago

updated the formatting,. I m using the spring-cloud-services.version>1.5.0.RELEASE. Other versions details are available in ticket.

I found a related ticket https://github.com/spring-cloud/spring-cloud-netflix/issues/2079

does it seems like cloud foundry issue?

spencergibb commented 7 years ago

I think this is the same as #2079

vimal-raz commented 7 years ago

I have opened a ticket with cloud foundry team. Will keep this ticket updated. thanks

dersteve commented 7 years ago

@vimal-raz Did you get any updates from the cloud foundry team? We are experiencing the exact same issue - also on CF.

vimal-raz commented 7 years ago

@dersteve , Our infra team is working closely with PCF support to find the solution. Here are findings so far: The reason for the 500 error is the NAT configuration in AWS. The AWS NAT Gateway is set to disconnect idle connections after 5 minutes.

vimal-raz commented 7 years ago

@dersteve PCF team suggested to use Spring retry in boot apps and zuul to handle this issue.

https://github.com/spring-projects/spring-retry https://docs.spring.io/spring-batch/trunk/reference/html/retry.html

AhmedRiahi commented 6 years ago

Hello,

Im encountring the same issue with "Connection Reset" exception, any update please ? Is it related to zuul ?

Thanks

manuelgerstner commented 6 years ago

We have been investigating this issue on our CloudFoundry architecture a bit more and it seems to be an issue with the Http client and the way connections are kept-alive. The issue appears when using either Apache HTTP Client (default) or OkHttp. It does not appear however, when using the deprecated restclient which was previously used as the default Http client. So this is the current fix for us (please note that the client is officially deprecated and according to some of the developers it was deprecated due to some bugs).

The following short paragraph talks about the three clients https://cloud.spring.io/spring-cloud-netflix/multi/multi__router_and_filter_zuul.html#_zuul_http_client

Another fix that could solve (cover-up) the issue would be to provide a custom Http client which disables connection keep-alive.

@spencergibb mentions that:

RestClient has limitations like not supporting PATCH and other bugs that are fixed with Apache

here: https://github.com/spring-cloud/spring-cloud-netflix/issues/1125

tomaszglinski commented 6 years ago

Is there something going on about this bug, since we have the same problems...

manuelgerstner commented 6 years ago

@tomaszglinski just out of curiosity, did you try to make use of the RestClient and did it fix the issue for you?

tcanavan commented 6 years ago

The RestClient installs a cleaner for the http connection pool. This cleaner closes connections and removes pool entries which are older than 30 seconds so they will be cleanly closed in time and never become a victim of the AWS 5 minute disconnect of idle connections rule.

The exception we are seeing is the following 

    at java.net.SocketInputStream.read(SocketInputStream.java:209)
    at java.net.SocketInputStream.read(SocketInputStream.java:141)
    at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
    at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
    at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
    at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
    at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
    at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
    at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
    at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
    at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
    at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
    at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
    at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
    at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
    at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
    at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
    at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
    at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
    at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
    at org.springframework.cloud.netflix.ribbon.apache.RetryableRibbonLoadBalancingHttpClient$1.doWithRetry(RetryableRibbonLoadBalancingHttpClient.java:94)
    at org.springframework.cloud.netflix.ribbon.apache.RetryableRibbonLoadBalancingHttpClient$1.doWithRetry(RetryableRibbonLoadBalancingHttpClient.java:72)
    at org.springframework.retry.support.RetryTemplate.doExecute(RetryTemplate.java:287)
    at org.springframework.retry.support.RetryTemplate.execute(RetryTemplate.java:164)
    at org.springframework.cloud.netflix.ribbon.apache.RetryableRibbonLoadBalancingHttpClient.executeWithRetry(RetryableRibbonLoadBalancingHttpClient.java:107)
    at org.springframework.cloud.netflix.ribbon.apache.RetryableRibbonLoadBalancingHttpClient.execute(RetryableRibbonLoadBalancingHttpClient.java:72)
    at org.springframework.cloud.netflix.ribbon.apache.RetryableRibbonLoadBalancingHttpClient.execute(RetryableRibbonLoadBalancingHttpClient.java:52)
    at com.netflix.client.AbstractLoadBalancerAwareClient$1.call(AbstractLoadBalancerAwareClient.java:109)

Spring retry is been used but in this case I think it has no real affect as

  1. The entry does not seem to be removed from the pool when exception is thrown.

  2. If another server gets retried it will also get the same error

There use to be an option to check the validity of the connection every time but this no longer works despite the property still existing. It was deemed to be not performant. The PoolingHttpClientConnectionManager does not seem to be set up for the client thats created in RetryableRibbonLoadBalancingHttpClient which means we cannot use the ValidateAfterInactivity property.

flenzi commented 6 years ago

This is closed but there's no fix?

satyendra-123 commented 6 years ago

I encountered the similar error. Code is deployed in Cloud Foundry. I am using zuul routes.

Edgware.RELEASE for jar Web Page Error: Whitelabel Error Page This application has no explicit mapping for /error, so you are seeing this as a fallback. Thu Aug 02 06:39:13 UTC 2018 There was an unexpected error (type=Internal Server Error, status=500). Connection reset ` ` ` 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] 2018-08-01 06:40:37.097 WARN 15 --- [nio-8080-exec-8] o.s.c.n.z.filters.post.SendErrorFilter : Error during filtering 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] java.net.SocketException: Connection reset 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at java.net.SocketInputStream.read(SocketInputStream.java:210) ~[na:1.8.0_131] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[na:1.8.0_131] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at sun.security.ssl.InputRecord.readFully(InputRecord.java:465) ~[na:1.8.0_131] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at sun.security.ssl.InputRecord.read(InputRecord.java:503) ~[na:1.8.0_131] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973) ~[na:1.8.0_131] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930) ~[na:1.8.0_131] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at sun.security.ssl.AppInputStream.read(AppInputStream.java:105) ~[na:1.8.0_131] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137) ~[httpcore-4.4.6.jar!/:4.4.6] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153) ~[httpcore-4.4.6.jar!/:4.4.6] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282) ~[httpcore-4.4.6.jar!/:4.4.6] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140) ~[httpclient-4.5.2.jar!/:4.5.2] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57) ~[httpclient-4.5.2.jar!/:4.5.2] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259) ~[httpcore-4.4.6.jar!/:4.4.6] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163) ~[httpcore-4.4.6.jar!/:4.4.6] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:167) ~[httpclient-4.5.2.jar!/:4.5.2] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273) ~[httpcore-4.4.6.jar!/:4.4.6] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125) ~[httpcore-4.4.6.jar!/:4.4.6] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271) ~[httpclient-4.5.2.jar!/:4.5.2] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184) ~[httpclient-4.5.2.jar!/:4.5.2] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88) ~[httpclient-4.5.2.jar!/:4.5.2] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.2.jar!/:4.5.2] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184) ~[httpclient-4.5.2.jar!/:4.5.2] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:117) ~[httpclient-4.5.2.jar!/:4.5.2] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55) ~[httpclient-4.5.2.jar!/:4.5.2] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.cloud.netflix.zuul.filters.route.SimpleHostRoutingFilter.forwardRequest(SimpleHostRoutingFilter.java:371) ~[spring-cloud-netflix-core-1.2.5.RELEASE.jar!/:1.2.5.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.cloud.netflix.zuul.filters.route.SimpleHostRoutingFilter.forward(SimpleHostRoutingFilter.java:297) ~[spring-cloud-netflix-core-1.2.5.RELEASE.jar!/:1.2.5.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.cloud.netflix.zuul.filters.route.SimpleHostRoutingFilter.run(SimpleHostRoutingFilter.java:181) ~[spring-cloud-netflix-core-1.2.5.RELEASE.jar!/:1.2.5.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at com.netflix.zuul.ZuulFilter.runFilter(ZuulFilter.java:112) ~[zuul-core-1.3.0.jar!/:1.3.0] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at com.netflix.zuul.FilterProcessor.processZuulFilter(FilterProcessor.java:193) ~[zuul-core-1.3.0.jar!/:1.3.0] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at com.netflix.zuul.FilterProcessor.runFilters(FilterProcessor.java:157) ~[zuul-core-1.3.0.jar!/:1.3.0] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at com.netflix.zuul.FilterProcessor.route(FilterProcessor.java:118) ~[zuul-core-1.3.0.jar!/:1.3.0] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at com.netflix.zuul.ZuulRunner.route(ZuulRunner.java:96) ~[zuul-core-1.3.0.jar!/:1.3.0] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at com.netflix.zuul.http.ZuulServlet.route(ZuulServlet.java:116) ~[zuul-core-1.3.0.jar!/:1.3.0] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at com.netflix.zuul.http.ZuulServlet.service(ZuulServlet.java:81) ~[zuul-core-1.3.0.jar!/:1.3.0] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.servlet.mvc.ServletWrappingController.handleRequestInternal(ServletWrappingController.java:157) [spring-webmvc-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.cloud.netflix.zuul.web.ZuulController.handleRequest(ZuulController.java:44) [spring-cloud-netflix-core-1.2.5.RELEASE.jar!/:1.2.5.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:50) [spring-webmvc-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:963) [spring-webmvc-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:897) [spring-webmvc-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970) [spring-webmvc-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:861) [spring-webmvc-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at javax.servlet.http.HttpServlet.service(HttpServlet.java:622) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846) [spring-webmvc-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at javax.servlet.http.HttpServlet.service(HttpServlet.java:729) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) [tomcat-embed-websocket-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.boot.web.filter.ApplicationContextHeaderFilter.doFilterInternal(ApplicationContextHeaderFilter.java:55) [spring-boot-1.5.1.RELEASE.jar!/:1.5.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) [spring-web-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.boot.actuate.trace.WebRequestTraceFilter.doFilterInternal(WebRequestTraceFilter.java:108) [spring-boot-actuator-1.5.1.RELEASE.jar!/:1.5.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:100) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177) [spring-security-web-4.2.1.RELEASE.jar!/:4.2.1.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) [spring-web-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262) [spring-web-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.099+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:99) [spring-web-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.security.oauth2.client.filter.OAuth2ClientContextFilter.doFilter(OAuth2ClientContextFilter.java:60) [spring-security-oauth2-2.0.12.RELEASE.jar!/:na] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(HttpPutFormContentFilter.java:105) [spring-web-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) [spring-web-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:81) [spring-web-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:197) [spring-web-4.3.6.RELEASE.jar!/:4.3.6.RELEASE] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.springframework.boot.actuate.autoconfigure.MetricsFilter.doFilterInternal(MetricsFilter.java:106) [spring-boot-actuator-1.5.1.RELEASE.jar!/:1.5.1.RELEASE] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:474) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:677) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:349) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:783) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:798) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1434) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_131] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_131] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) [tomcat-embed-core-8.5.11.jar!/:8.5.11] 2018-08-01T12:10:37.100+05:30 [APP/PROC/WEB/0] [OUT] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_131] ```
ryanjbaxter commented 6 years ago

It was closed as a duplicate of #2079