search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.43k stars 955 forks source link

[core][spark] Support updating nested column types in Spark #4494

Closed tsreaper closed 1 week ago

tsreaper commented 1 week ago

Purpose

Currently Paimon only supports updating not nested column types. This PR supports updating nested column types, and also adds support to Spark.

Tests

Unit tests and IT cases.

API and Format

No format changes.

Documentation

Document will be added later.