pystorm / streamparse

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
http://streamparse.readthedocs.io/
Apache License 2.0
1.5k stars 218 forks source link

Suggestion: Ability to pass the cli run command a pre-built jar #406

Open jcallin opened 6 years ago

jcallin commented 6 years ago

The Uber-JAR I'm creating takes 2+ minutes to build, it would be nice to be able to run a jar locally that is already built. Right now, you have to run sparse run which rebuilds the jar. I see the code for run_local_topology in the run.py cli uses a storm command to run a jar locally which it builds on the spot. Maybe this could be modified to alternatively use a prebuilt jar based on a command line arg?

I thought about just running it with storm jar like run.py does, but then you need to define the yaml file. It would be convenient to have this functionality packaged in with run to make use of the streamparse ability to define topologies in Python.

Not sure how long this might take, but I could probably open a PR in the near future.