madiele
commented
4 months ago https://github.com/rabbitmq/rabbitmq-consistent-hash-exchange
8 queues with same weight
publish routing key = hash of the text in the message
1 exchange -> routing with hash -> 8 queues -> x consumers listening on queues
when a chapter is requested for generation its hash will be used to identify it
generation is grouped by hash, the same hash can not be generated in parallel
book can have chapter generated in parallel
when dequeued there will be a check to prevent the same chapter to be generated twice