aws / aws-app-mesh-roadmap

AWS App Mesh is a service mesh that you can use with your microservices to manage service to service communication
Apache License 2.0
347 stars 25 forks source link

HTTP cache and stale cache support #63

Open cristoirmac opened 5 years ago

cristoirmac commented 5 years ago

Allow the proxy to serve stale HTTP response from downstream API if the API is not responsive

Which integration(s) is this request for? EC2 and ECS

Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard? We use Nginx today which allows you to set short TTLs on caches per endpoint (10 seconds/60 seconds) but also we can configure Nginx to use stale cache if there is a failure or timeout with the downstream service. This greatly improves response times and reliability.

Are you currently working around this issue? We currently use NGINX

bcelenza commented 5 years ago

Great idea! There's an open proposal for Envoy Proxy to add this functionality (https://github.com/envoyproxy/envoy/issues/868), so we would likely follow that with our implementation of its configuration.

vishnuvisnu commented 3 years ago

Envoy proxy implementation is completed https://github.com/envoyproxy/envoy/issues/868, any progress on this?