mailgun / kafka-pixy

gRPC/REST proxy for Kafka
Apache License 2.0
773 stars 118 forks source link

Negative Offsets #196

Closed david-terk closed 2 years ago

david-terk commented 3 years ago

How is it possible that a negative offset is generated?

{
    "partition": 2,
    "begin": 659004,
    "end": 1122013,
    "count": 463009,
    "offset": 1122121,
    "lag": -108,
    "metadata": "7UzI",
    "sparse_acks": "667-942"
}

It seems that when this occurs no message is emitted.

When I saw this - I did seek to the end of the stream so perhaps there is something going on with a batch being pulled that forces the offsets forward to a value which doesn't really make sense.