search

pystorm / streamparse

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
http://streamparse.readthedocs.io/
Apache License 2.0
1.5k stars 218 forks source link

Add dynamic lookup of storm supervisors #389

Closed codywilbourn closed 7 years ago

codywilbourn commented 7 years ago

Look up the storm workers from the nimbus server unless hostnames are explicitly defined in config.json, or the network lookup is explicitly prohibited (also in config.json). This will allow more dynamic expansion of storm clusters without requiring hostname list updates.

Also added documentation about this lookup to FAQ

coveralls commented 7 years ago

Coverage Status

Coverage decreased (-0.3%) to 47.527% when pulling 70e6de8191bd6233e6eafedd9fcde66ef3644aab on codywilbourn:fetch-workers into b2a82197160c9b899e60980d40e650e659799df7 on Parsely:master.

coveralls commented 7 years ago

Coverage Status

Coverage decreased (-0.3%) to 47.527% when pulling 6449c54f3367f11969e5ace25d68663166074f7d on codywilbourn:fetch-workers into b2a82197160c9b899e60980d40e650e659799df7 on Parsely:master.

coveralls commented 7 years ago

Coverage Status

Coverage decreased (-0.3%) to 47.527% when pulling 4e5ceffd5ec1b1bfc4ec61f9959da26c5904b7a8 on codywilbourn:fetch-workers into b2a82197160c9b899e60980d40e650e659799df7 on Parsely:master.

coveralls commented 7 years ago

Coverage Status

Coverage decreased (-0.3%) to 47.527% when pulling 4e5ceffd5ec1b1bfc4ec61f9959da26c5904b7a8 on codywilbourn:fetch-workers into b2a82197160c9b899e60980d40e650e659799df7 on Parsely:master.