#74 should be merged before this one. If it's not accepted, I should adjust this one accordingly.
Continuation of the performance work started in #75. A good chunk of the compute done by the Edge Proxy is JSON marshalling and unmarshalling, and having a more performant library has an impact.
Serving Todoist and Twist on a few ECS instances with 4 vCPUs shows:
Reduction in average CPU usage of ~1%
Reduction in p99 latency of ~5%
Increased throughput by ~8%
With #75 and this one, an ECS instance with 4 vCPU can now handle 3000 requests per minute without noticeable variation to p99 latency.
#74 should be merged before this one. If it's not accepted, I should adjust this one accordingly.
Continuation of the performance work started in #75. A good chunk of the compute done by the Edge Proxy is JSON marshalling and unmarshalling, and having a more performant library has an impact.
Serving Todoist and Twist on a few ECS instances with 4 vCPUs shows:
With #75 and this one, an ECS instance with 4 vCPU can now handle 3000 requests per minute without noticeable variation to p99 latency.