[Feature] Support schema evolution for nested struct add new children fields.

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

https://paimon.apache.org/

Apache License 2.0

2.28k stars 912 forks source link

[Feature] Support schema evolution for nested struct add new children fields. #3922

Open gnailJC opened 1 month ago

gnailJC commented 1 month ago

Search before asking

[X] I searched in the issues and found nothing similar.

Motivation

Support schema evolution about nested data type such as StructType(Spark). For example: Struct<name: String, age: Int> to Stuct<name: String, age: Int, phone: Str>

Solution

Anything else?

Are you willing to submit a PR?

[ ] I'm willing to submit a PR!

gnailJC commented 1 month ago

@JingsongLi Are there any plans to support this feature?