socialpandas / sidekiq-superworker

Directed acyclic graphs of Sidekiq jobs
MIT License
438 stars 34 forks source link

Unreliable execution #53

Open cassiopagnoncelli opened 6 years ago

cassiopagnoncelli commented 6 years ago
  1. Start a Superworker S which runs two workers in serial mode A then B, say each takes 10s.
  2. Kill Sidekiq abruptly while A is still executing, eg. pkill -9 sidekiq.
  3. Restart Sidekiq.
  4. attentive_sidekiq gem can recover worker A and execute it.

Problem: B will never execute, superworker S will never finish.