aiven / kafka

Mirror of Apache Kafka
Apache License 2.0
2 stars 1 forks source link

Deleting records doesn't cause deleting remote segments #20

Closed ivanyu closed 1 month ago

ivanyu commented 1 year ago
  1. Create a topic with tiered storage.
  2. Fill the topic with some data and wait until segments are uploaded.
  3. Use kafka-delete-records.sh to delete e.g. a half of the data.
  4. Observe that neither eligible segments are removed from the remote tier nor there are relevant new records in __remote_log_metadata.

org.apache.kafka.server.log.remote.storage.LocalTieredStorage as the RSM is enough to reproduce.