Router - Local Dev Fast Ctrl-C Handling - Githubissues

pwrdrvr / lambda-dispatch

Lambda Dispatch for AWS Lambda - Avoid cold starts, save up to 80%!

38 stars 3 forks source link

Router - Local Dev Fast Ctrl-C Handling #7

Open huntharo opened 10 months ago

huntharo commented 10 months ago

Motivations

Currently the router hangs on Ctrl-C for up to a minute
There is no cancellation token to cancel all long-running tasks gracefully
Note: graceful exit under ECS works fine because ECS is deregistering tasks with the ALB before shutting down the containers

Overview

[ ] Add signal handlers that signal a cancellation token when other processes have wrapped up
[ ] Start failing health checks after receiving SIGTERM
[ ] Wait a bit then signal the cancel token to break out of the scheduled loops like metrics, queue dispatcher, and rebalancer

huntharo commented 9 months ago

Testing with ECS, scaling up and down the containers using oha for load testing, shows no dropped requests or errors while running at 12,000 RPS.

./oha-linux-amd64 -z 10sm -c 400 https://lambdadispatch.ghpublic.pwrdrvr.com/ping