dahlia / fedify

ActivityPub server framework in TypeScript
https://fedify.dev/
MIT License
500 stars 19 forks source link

Parallelize task workers #106

Closed dahlia closed 2 weeks ago

dahlia commented 2 months ago

Currently, Fedify processes the tasks that come into the message queue one at a time, but we need to parallelize them to increase throughput.

dahlia commented 2 months ago

Apparently Deno KV does not allow more than once workers to consume messages at once. We need to categorize MessageQueue implementations by whether they can be parallelized or not.