apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.35k stars 928 forks source link

[core] Support stream read with delay duration #4067

Closed xuzifu666 closed 1 month ago

xuzifu666 commented 1 month ago

Purpose

Support stream read with delay duration. real user scenario is algorithm partital update, user use lake table join hbase/redis dim table, but dim table update is delay, so need delay read for stream lake table. this pr is aim to support it with add an option to control the delay time.

Linked issue: close #xxx

Tests

API and Format

Documentation

JingsongLi commented 1 month ago

+1