apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.13k stars 842 forks source link

[spark] Avoid unnecessary get splits in spark scan #3645

Closed Zouxxyy closed 6 days ago

Zouxxyy commented 6 days ago

Purpose

Avoid unnecessary get splits in spark scan

Tests

API and Format

Documentation