search

adobe-apiplatform / apigateway

A Performant API Gateway based on NGINX and Openresty
MIT License
300 stars 57 forks source link

Please make proxy_read_timeout configurable #49

Open herisanu opened 7 years ago

herisanu commented 7 years ago

Hey guys, we've hit an issue with requests that take more than 10s.

https://github.com/adobe-apiplatform/apigateway/blob/master/api-gateway-config/conf.d/marathon_apis.conf#L74-L76

The proxy_read_timeout is set at 10 seconds in the nginx server of apigateway and can not be changed via a setting in the dcos package. https://git.corp.adobe.com/adobe-platform/dcos-universe-private/tree/master/repo/packages/A/apigateway/3

We can confirm that calls over 10s are getting 504 results. We can't assume our API calls take less than 10s. Could you please add this as an configurable parameter or provide a workaround for calls >10s?

193.105.140.131 - - [20/Apr/2017:07:59:12 +0000] request="GET /api/v1/072449F857E4EA160A49411B%40AdobeOrg/connections/58e74daea90440000ee5539a/objects HTTP/1.1" api_key="" status=504 bbs=84 rl=2025 rt=10.001 hr="http://connectorsrest-dev-c3ddb09d52--cr.gw.dev.mc.adobe.net/docs/" ua="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36" xfwdf="-" upadd="10.13.100.7:26856" upstat=504 uprt="10.001" sid="connectorsrest-dev-c3ddb09d52--cr" sname="TBD" reqid=qGMkwjo5hR9ZeAOFNFEzaLQVnfnKv3dp
193.105.140.131 - - [20/Apr/2017:07:59:48 +0000] request="GET /api/v1/072449F857E4EA160A49411B%40AdobeOrg/connections/58e74daea90440000ee5539a/objects HTTP/1.1" api_key="" status=504 bbs=84 rl=2068 rt=10.002 hr="http://connectorsrest-dev-c3ddb09d52--cr.gw.dev.mc.adobe.net/docs/" ua="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36" xfwdf="-" upadd="10.13.100.7:26856" upstat=504 uprt="10.002" sid="connectorsrest-dev-c3ddb09d52--cr" sname="TBD" reqid=ce6VTzuqWWdGKaRzIDiX3ChKfB60dCFw
193.105.140.131 - - [20/Apr/2017:08:06:17 +0000] request="GET /api/v1/072449F857E4EA160A49411B%40AdobeOrg/connections/58e74daea90440000ee5539a/objects HTTP/1.1" api_key="" status=504 bbs=84 rl=2068 rt=10.002 hr="http://connectorsrest-dev-c3ddb09d52--cr.gw.dev.mc.adobe.net/docs/" ua="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36" xfwdf="-" upadd="10.13.100.7:26856" upstat=504 uprt="10.002" sid="connectorsrest-dev-c3ddb09d52--cr" sname="TBD" reqid=nfjnOGTldPSTDDqAyQeobSTvM5nAKMHP
193.105.140.131 - - [20/Apr/2017:09:33:18 +0000] request="GET /api/v1/072449F857E4EA160A49411B%40AdobeOrg/connections/58e74daea90440000ee5539a/objects HTTP/1.1" api_key="" status=504 bbs=84 rl=2062 rt=10.003 hr="http://connectorsrest-dev-c3ddb09d52--cr.gw.dev.mc.adobe.net/docs/" ua="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36" xfwdf="-" upadd="10.13.100.7:7665" upstat=504 uprt="10.003" sid="connectorsrest-dev-c3ddb09d52--cr" sname="TBD" reqid=dtbTluSKImvdCgyodm2X6FXHCvMb1Ytq
193.105.140.131 - - [20/Apr/2017:12:27:04 +0000] request="GET /api/v1/072449F857E4EA160A49411B%40AdobeOrg/connections/58e74daea90440000ee5539a/objects HTTP/1.1" api_key="" status=504 bbs=84 rl=2062 rt=10.003 hr="http://connectorsrest-dev-c3ddb09d52--cr.gw.dev.mc.adobe.net/docs/" ua="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36" xfwdf="-" upadd="10.13.100.7:7665" upstat=504 uprt="10.003" sid="connectorsrest-dev-c3ddb09d52--cr" sname="TBD" reqid=Pccf2KWrS0i2q6JqoKo9FkBSJofLOcdy
193.105.140.131 - - [20/Apr/2017:12:39:58 +0000] request="GET /api/v1/072449F857E4EA160A49411B%40AdobeOrg/connections/58e74daea90440000ee5539a/objects HTTP/1.1" api_key="" status=504 bbs=84 rl=2062 rt=10.003 hr="http://connectorsrest-dev-c3ddb09d52--cr.gw.dev.mc.adobe.net/docs/" ua="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36" xfwdf="-" upadd="10.13.100.7:7665" upstat=504 uprt="10.003" sid="connectorsrest-dev-c3ddb09d52--cr" sname="TBD" reqid=VmOPIgZeqGGYsPV6uikbVZyfQpwSmQoy
193.105.140.131 - - [20/Apr/2017:12:53:07 +0000] request="GET /api/v1/072449F857E4EA160A49411B%40AdobeOrg/connections/58e74daea90440000ee5539a/objects HTTP/1.1" api_key="" status=504 bbs=84 rl=2062 rt=10.002 hr="http://connectorsrest-dev-c3ddb09d52--cr.gw.dev.mc.adobe.net/docs/" ua="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36" xfwdf="-" upadd="10.13.100.7:7665" upstat=504 uprt="10.002" sid="connectorsrest-dev-c3ddb09d52--cr" sname="TBD" reqid=kEifTYGn7SnmFIKpfQtFUlNCWgJIa6fq
193.105.140.131 - - [20/Apr/2017:12:53:07 +0000] request="GET /api/v1/072449F857E4EA160A49411B%40AdobeOrg/connections/58e74daea90440000ee5539a/objects HTTP/1.1" api_key="" status=504 bbs=84 rl=2062 rt=10.001 hr="http://connectorsrest-dev-c3ddb09d52--cr.gw.dev.mc.adobe.net/docs/" ua="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36" xfwdf="-" upadd="10.13.100.7:7665" upstat=504 uprt="10.001" sid="connectorsrest-dev-c3ddb09d52--cr" sname="TBD" reqid=n3ONgAcNjbZmTvWz3qCznhGJXCFOq1nH
127.0.0.1 - - [20/Apr/2017:13:21:18 +0000] request="GET /api/v1/072449F857E4EA160A49411B%40AdobeOrg/connections/58e74daea90440000ee5539a/objects HTTP/1.1" api_key="" status=504 bbs=84 rl=2028 rt=10.002 hr="http://connectorsrest-dev-c3ddb09d52--cr.gw.dev.mc.adobe.net/docs/" ua="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36" xfwdf="-" upadd="10.13.100.7:7665" upstat=504 uprt="10.002" sid="connectorsrest-dev-c3ddb09d52--cr" sname="TBD" reqid=ApJD6zgwOkkwpQLqgcRVDzgELzqFxWWJ