fail_tuple without any clue

pystorm / streamparse

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.

http://streamparse.readthedocs.io/

Apache License 2.0

1.5k stars 218 forks source link

fail_tuple without any clue #463

Closed mbande closed 5 years ago

mbande commented 5 years ago

a have a topology with bolts that auto_fail and auto_ack is True for them (as default). so, as mentioned in documents, failing a tuple should occur only in case of an uncaught Exception in bolts, which leads to bolts process reset. recently, its very common that many tuples fails together, without any Exception in topology. isn't this a bug in streamparse? UPDATE: it seems that fails occur in regular periods (120 seconds)

mbande commented 5 years ago

messages was failing because of low topology.message.timeout.secs value