[Feature] Support Flink sourceIdleTime metric in Paimon Source

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

https://paimon.apache.org/

Apache License 2.0

2.44k stars 959 forks source link

[Feature] Support Flink sourceIdleTime metric in Paimon Source #4249

Open xiangyuf opened 2 months ago

xiangyuf commented 2 months ago

Search before asking

[X] I searched in the issues and found nothing similar.

Motivation

We need sourceIdleTime metric to get the right currentFetchEventTimeLag metric. User also need sourceIdleTime metric to monitor how long the source table has not been updated.

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

[ ] I'm willing to submit a PR!

qingfei1994 commented 4 weeks ago

Hi @xiangyuf, may I work on this issue?

xiangyuf commented 4 weeks ago

Hi @xiangyuf, may I work on this issue?

@qingfei1994 thx for volunteering, you can take this task. You can also work on this(https://github.com/apache/paimon/issues/4244) if you have time.

xiangyuf commented 4 weeks ago

@JingsongLi Could you help assign this to @qingfei1994 ?