apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.43k stars 954 forks source link

[core][spark] Support renaming nested columns in Spark #4489

Closed tsreaper closed 1 week ago

tsreaper commented 1 week ago

Purpose

Currently Paimon only supports renaming not nested columns. This PR supports renaming nested columns in Paimon, and also add support to Spark.

Tests

Unit tests and IT cases.

API and Format

No format changes.

Documentation

Document will be added in a dedicated PR.