pystorm / streamparse

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
http://streamparse.readthedocs.io/
Apache License 2.0
1.5k stars 218 forks source link

Serializer Exception with msgpack Serializer #403

Open LImoritakeU opened 6 years ago

LImoritakeU commented 6 years ago

Hello, I tried to test msgpack serializer with an quickstart wordcount example, but there is an Serializer Exception issue... Actually I'm not sure this is an real issue or just another operation fault. :-P .

java.lang.RuntimeException: org.apache.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read.
Serializer Exception:
Traceback (most recent call last):
  File "/home/shihhao/.local/share/virtualenvs/streamparse-3JLpgEJK/bin/streamparse_run", line 11, in <module>
    sys.exit(main())
  File "/home/shihhao/.local/share/virtualenvs/streamparse-3JLpgEJK/lib/python3.6/site-packages/streamparse/run.py", line 45, in main
    cls(serializer=args.serializer).run()
  File "/home/shihhao/.local/share/virtualenvs/streamparse-3JLpgEJK/lib/python3.6/site-packages/pystorm/component.py", line 483, in run
    storm_conf, context = self.read_handshake()
  File "/home/shihhao/.local/share/virtualenvs/streamparse-3JLpgEJK/lib/python3.6/site-packages/pystorm/component.py", line 311, in read_handshake
    pid_dir, _conf, _context = msg['pidDir'], msg['conf'], msg['context']
TypeError: 'int' object is not subscriptable
{                                                                                                                                                                                         
    "serializer": "msgpack",                                                                                                                                                              
    "topology_specs": "topologies/",                                                                                                                                                      
    "virtualenv_specs": "virtualenvs/",                                                                                                                                                   
    "envs": {                                                                                                                                                                             
        "local-dev": {                                                                                                                                                                                                                                                                                                                   
            "nimbus": "127.0.0.1",                                                                                                                                                        
            "workers": ["127.0.0.1"],                                                                                                                                                     
            "log": {                                                                                                                                                                      
                "level": "error"                                                                                                                                                          
            },                                                                                                                                                                            
            "use_ssh_for_nimbus": false,                                                                                                                                                  
            "virtualenv_root": "/home/shihhao/.virtualenvs/stream",                                                                                                                       
            "use_virtualenv": true                                                                                                                                                        
        }                                                                                                                                                                                                                                                                                                                                       
    }                                                                                                                                                                                     
}                     

streamparse==3.11.0 Python 3.6.2