iceberg: add snapshot references - Githubissues

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

https://redpanda.com

9.46k stars 579 forks source link

iceberg: add snapshot references #23482

Closed andrwng closed 2 days ago

andrwng commented 2 days ago

Iceberg has the concept of snapshot references, which are basically named pointers at snapshots in metadata. This adds the definition for this, and adds the structure of the table update/requirement that will use it.

https://iceberg.apache.org/spec/#snapshot-references

Backports Required

[x] none - not a bug fix
[ ] none - this is a backport
[ ] none - issue does not exist in previous branches
[ ] none - papercut/not impactful enough to backport
[ ] v24.2.x
[ ] v24.1.x
[ ] v23.3.x

Release Notes

none

ducktape was retried in https://buildkite.com/redpanda/redpanda/builds/55126#01922a55-b287-4f8d-9d2a-58b621ee74ab

ducktape was retried in https://buildkite.com/redpanda/redpanda/builds/55126#01922a56-7744-4f64-a82c-33421a3c0f79