Added conversion from `iceberg::value` to `serde::parquet::value`

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

https://redpanda.com

9.65k stars 589 forks source link

Added conversion from `iceberg::value` to `serde::parquet::value` #24117

Closed mmaslankaprv closed 1 day ago

mmaslankaprv commented 2 days ago

The value conversion is a necessary step before writing parquet format using serde::parquet::writer. Conversion translates the iceberg::value types into a corresponding parquet::value.

Backports Required

[x] none - not a bug fix
[ ] none - this is a backport
[ ] none - issue does not exist in previous branches
[ ] none - papercut/not impactful enough to backport
[ ] v24.2.x
[ ] v24.1.x
[ ] v23.3.x

Release Notes

none

vbotbuildovich commented 2 days ago

ducktape was retried in https://buildkite.com/redpanda/redpanda/builds/58051#01932a29-8049-41a9-a8f4-f952de07dfa0