[Feature] CDC Action Automatically create tag - Githubissues

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

https://paimon.apache.org/

Apache License 2.0

2.1k stars 834 forks source link

[Feature] CDC Action Automatically create tag #3619

Open melin opened 5 days ago

melin commented 5 days ago

Search before asking

[X] I searched in the issues and found nothing similar.

Motivation

很多客户，需要把数据实时同步到数据湖，但后续还是流程换是离线数仓方式，需要拉链表（每天一个tag），如果cdc action 支持自动化创建tag，会很方便。类似这个功能；https://www.alibabacloud.com/help/zh/flink/use-cases/tag-creation-and-management?spm=a2c63.p38356.0.0.bd262597u4TZOL#dd94a5869c7fn

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

[ ] I'm willing to submit a PR!

gsralex commented 5 days ago

please assign to me

yuzelin commented 5 days ago

You can set tag-auto-creation arguments by --table_conf to enable it. Could you please have a try ?