search

adevinta / zoe

The Kafka CLI for humans
https://adevinta.github.io/zoe
MIT License
286 stars 21 forks source link

Seeking past an offset #42

Closed mastery-amit-sahani closed 2 years ago

mastery-amit-sahani commented 3 years ago

Do we have the capability to seek past an offset using zoe?

failure: Error deserializing key/value for partition test.v0-2 at offset 26. If needed, please seek past the record to continue consumption. (type: org.apache.kafka.common.errors.SerializationException)

wlezzar commented 2 years ago

Hi @mastery-amit-sahani ! . Thanks for raising this issue.

Today, we don't have this feature indeed. I understand how annoying it is however, so I opened a PR here to try to solve the issue. The PR doesn't add a seek offset functionality per say. Instead, it adds an optional --skip-non-deserializable-records flag to ignore deserialization errors and log them only. This way, you can go past corrupt records.

Does this answer your use case?

wlezzar commented 2 years ago

The feature is available in the latest zoe version (v0.27.3). Feel free to reopen this issue if this doesn't answer your use case.

mastery-amit-sahani commented 2 years ago

Thanks @wlezzar I'll give this a try.