search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.48k stars 970 forks source link

[core] Support schema table push down range query predicate #4146

Closed xuzifu666 closed 2 months ago

xuzifu666 commented 2 months ago

Purpose

Linked issue: close #xxx Currently range query with schema table not support range push down, this pr had two points changed:

  1. support range query push down to Schema Table, which may improve query with schema in conditions such as schema changed frequently;
  2. throw out and reminder user schema id range when user query not exist schema id.

Tests

CatalogTableITCase##testSchemasTable with adding more case for the method.

API and Format

Documentation