getsentry / arroyo

A library to build streaming applications that consume from and produce to Kafka.
https://getsentry.github.io/arroyo/
Apache License 2.0
41 stars 7 forks source link

ref: Add extra logging for debugging commits #302

Closed lynnagara closed 10 months ago

lynnagara commented 10 months ago

There is a mystery right now which is causing (probably) very old commit messages to still be present. This seems to be the case even after we switched the cleanup policy on the topic to compact,delete from compact in all environments so that messages eventually expire (they previously never expired). This adds some logging to help us figure out where/when these old messages came from and helps us determine when the legacy decoder can be safely removed.