Parsely / pykafka

Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
http://pykafka.readthedocs.org/
Apache License 2.0
1.12k stars 232 forks source link

Inactive partitions break fast-forwarding #90

Closed kbourgoin closed 11 years ago

kbourgoin commented 11 years ago

This is a fairly specific case, but one that should be handled:

In this case, the client fast-forwards, but has nothing to read and ends up entering an infinite loop where it's constantly fast-forwarding but not getting anywhere.

I didn't investigate long enough to determine if it's an actual loop or it's just that every time next_message is call it prints the log warning. It may just be that the message needs to be suppressed in this case.

kbourgoin commented 11 years ago

I've reworked some of the code around fast-forwarding and generally handling OffsetOutOfRange errors. The issue's been taken care of. Verified by testing the case manually.