search

IBM / sarama

Sarama is a Go library for Apache Kafka.
MIT License
11.57k stars 1.76k forks source link

Behavior : Messages marked for deletion #1745

Closed harshana-pickme closed 1 year ago

harshana-pickme commented 4 years ago
Versions
Problem Description

Hi all,

On a compacted topic, kafka will first mark duplicate messages for deletion and then physically remove them later.

  1. Does sarama consumers receive these marked for deletion messages ?
  2. if so how can the application know if a messages is marked for deletion ?

Thanks, Harshana

harshana-pickme commented 4 years ago

Can someone enlighten me on this ?

ghost commented 3 years ago

Thank you for taking the time to raise this issue. However, it has not had any activity on it in the past 90 days and will be closed in 30 days if no updates occur. Please check if the master branch has already resolved the issue since it was raised. If you believe the issue is still valid and you would like input from the maintainers then please comment to ask for it to be reviewed.

dnwe commented 1 year ago

A FetchRequest to a compacted topic will only ever retrieve the most recent value for a given key on a compacted topic. The marking for deletion / tombstoning of the superseded older values and their eventual removal is transparent to a client