Faktory for serverless workers - Githubissues

contribsys / faktory

Language-agnostic persistent background job server

https://contribsys.com/faktory/

Other

5.76k stars 230 forks source link

Faktory for serverless workers #329

Open mperham opened 3 years ago

mperham commented 3 years ago

AWS Lambda, Google Cloud Run and others are making it increasingly easy to deploy event-based serverless apps. What would it look like to have a version of Faktory which works "natively" with this architecture?

Spec out easy deployment for a Faktory server
- [x] AWS ECS
- [ ] Heroku (possible add-on to make this a button click?)
- [ ] Render
[ ] Spec out semantics for a limited time worker, one that spins up, executes jobs and exits under some condition.

TODO

How do we autoscale up the workers from 0 -> 1 -> N?
Under what conditions does the worker exit?
- [x] Lambda has a time limit so I'd suggest either that time limit or all queues are empty.