search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.16k stars 855 forks source link

[core] Use rawConvertible to determine whether needs to convertToRawFiles #3500

Closed Zouxxyy closed 1 month ago

Zouxxyy commented 1 month ago

Purpose

3226 Add rawConvertible in DataSplit, and remove the lazy loading mechanism.

We should use rawConvertible to determine whether needs to convertToRawFiles to preventing double convert

Tests

API and Format

Documentation