pystorm / streamparse

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
http://streamparse.readthedocs.io/
Apache License 2.0
1.5k stars 218 forks source link

Tuple id is not getting set #345

Closed hardik127 closed 7 years ago

hardik127 commented 7 years ago

I am setting tup_id to some integer which is less than 1000 right now. but it is not setting that id.

57690 [Thread-57] INFO  o.a.s.t.ShellBolt - ShellLog pid:82087, name:filter_user_on_timeline_bolt Tuple(id=u'5470057346245219256', component=u'0_user_analysis_spout', stream=u'default', task=2, values=_0_User_Analysis_SpoutDefaultTuple(users_list=u'{"type": "xxx", "id": "xxx"}'))
60492 [Thread-57] ERROR o.a.s.t.ShellBolt - Halting process: ShellBolt died. Command: [streamparse_run, bolts.filter_user_on_timeline.FilterUserOnTimelineBolt], ProcessInfo pid:82087, name:filter_user_on_timeline_bolt exitCode:-1, errorString:
java.lang.RuntimeException: Acked a non-existent or already acked/failed id: 5470057346245219256
    at org.apache.storm.task.ShellBolt.handleAck(ShellBolt.java:188) [storm-core-1.0.2.jar:1.0.2]
    at org.apache.storm.task.ShellBolt.access$900(ShellBolt.java:70) [storm-core-1.0.2.jar:1.0.2]
    at org.apache.storm.task.ShellBolt$BoltReaderRunnable.run(ShellBolt.java:345) [storm-core-1.0.2.jar:1.0.2]
    at java.lang.Thread.run(Thread.java:745) [?:1.8.0_92]
60498 [Thread-57] ERROR o.a.s.d.executor -
java.lang.RuntimeException: Acked a non-existent or already acked/failed id: 5470057346245219256
    at org.apache.storm.task.ShellBolt.handleAck(ShellBolt.java:188) [storm-core-1.0.2.jar:1.0.2]
    at org.apache.storm.task.ShellBolt.access$900(ShellBolt.java:70) [storm-core-1.0.2.jar:1.0.2]
    at org.apache.storm.task.ShellBolt$BoltReaderRunnable.run(ShellBolt.java:345) [storm-core-1.0.2.jar:1.0.2]
    at java.lang.Thread.run(Thread.java:745) [?:1.8.0_92]