edgurgel / verk

A job processing system that just verks! 🧛‍
https://hex.pm/packages/verk
MIT License
721 stars 65 forks source link

Jobs running on servers that don't have that queue #158

Closed novaugust closed 6 years ago

novaugust commented 6 years ago

I have a cluster of nodes all responsible for running different queues with some overlap.

My configuration is something like this

machine = ...
queues = 
  case machine do
    :worker -> [a: 5, b: 5, c: 5]
    :web -> [a: 5]
  end
config :verk, queues: queues

The intention here is to keep the web server from overworking itself between web requests and running jobs.

The issue, though, is that the :web server still occasionally runs jobs from queues b and c. Am I missing something here for keeping it from doing so?

novaugust commented 6 years ago

Digging in, it looks like I'm just bad at config. Sorry =)

novaugust commented 6 years ago

If someone else ever does this, remember that queues themselves will be deepmerged in config since they're just keyword maps.