newbie question: multiple threads in local mode

[bwalsh]

Congratulations on a great project. I was able to get it up in running in a few hours.

One question: In local mode, should I see some degree of parallelism? All my bolts are logging with the same thread id

80800 [Thread-24] INFO  FilterBolt  ....
80802 [Thread-24] INFO  FilterBolt ....

[colinsurprenant]

@bwalsh absolutely, all Storm paralelism controls works in local mode. Here are a few pointers to better understand the wait it works: https://github.com/nathanmarz/storm/wiki/Local-mode https://github.com/nathanmarz/storm/wiki/Understanding-the-parallelism-of-a-Storm-topology

you can check in the examples but here's a sample:

      bolt SomeBolt, :parallelism => 2 do
        [...]
      end

      configure do |env|
        max_task_parallelism 4
        num_workers 2
        max_spout_pending 100
      end

Let me know if you can make it work for you or if you have any more questions

[bwalsh]

Thanks very much for the quick response. Changing the source of the bolt from :global to :shuffle worked.

  bolt FilterBolt , :parallelism => 4 do
    source FileSpout, :shuffle
  end