pystorm / streamparse

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
http://streamparse.readthedocs.io/
Apache License 2.0
1.5k stars 218 forks source link

Sparse run error should be descriptive #344

Open j-bennet opened 7 years ago

j-bennet commented 7 years ago

The old flux error from streamparse is not descriptive anymore.

(casterisk) --- repos/casterisk ‹bugfix/trim-tweet-fields➔› » sparse run -n twitter -o topology.deployment_stage="docker" -e docker                                                                                                       1 ↵
/Users/irina/.pyenv/versions/casterisk/lib/python2.7/site-packages/streamparse/cli/common.py:36: UnsafeLoaderWarning:
The default 'Loader' for 'load(stream)' without further arguments can be unsafe.
Use 'load(stream, Loader=ruamel.yaml.Loader)' explicitly if that is OK.
Alternatively include the following in your code:

  import warnings
  warnings.simplefilter('ignore', ruamel.yaml.error.UnsafeLoaderWarning)

In most other cases you should consider using 'safe_load(stream)'
  items[key] = yaml.load(val)
No handlers could be found for logger "pykafka.topic"
Cleaning from prior builds...
Creating topology Uber-JAR...
Uber-JAR created: /Users/irina/repos/casterisk/_build/stormtest-0.0.1-SNAPSHOT-standalone.jar
Removing _resources temporary directory...done

Fatal error: local() encountered an error (return code 1) while executing 'storm jar /Users/irina/repos/casterisk/_build/stormtest-0.0.1-SNAPSHOT-standalone.jar org.apache.storm.flux.Flux --local --no-splash --sleep 9223372036854775807 /var/folders/87/zcwvn1_x5nv2dmtjlhmd9gjh0000gn/T/tmpbc0m4v.yaml'

Aborting.

When I run this manually:

storm jar /Users/irina/repos/casterisk/_build/stormtest-0.0.1-SNAPSHOT-standalone.jar org.apache.storm.flux.Flux --local --no-splash --sleep 9223372036854775807 /var/folders/87/zcwvn1_x5nv2dmtjlhmd9gjh0000gn/T/tmpbc0m4v.yaml

Here is what I get:

Error: Could not find or load main class org.apache.storm.flux.Flux

streamparse should output the error, as well as error code.