apache / iceberg

Apache Iceberg
https://iceberg.apache.org/
Apache License 2.0
6.49k stars 2.24k forks source link

Flink: Add RowConverter for Iceberg Source #11312

Open abharath9 opened 1 month ago

abharath9 commented 1 month ago

Feature Request / Improvement

Currently we can't create views on top of IcebergSource DataStreams directly. We need to convert the RowData to Row explicitly using map function. I thought creating a RowConverter to convert RowData to Row and return IcebergSource would be a good idea. This approach enables the use of the Iceberg schema to create a DataStream and further create a view on top of it. What are your thoughts?

Query engine

Flink

Willingness to contribute

abharath9 commented 1 month ago

Implemented this change and created a pr. Can i get a review on this? https://github.com/apache/iceberg/pull/11301 https://github.com/apache/iceberg/pull/11301