[Feature Request]: Dynamic Table Refresh Improvement

[gavinyue]

Is there an existing issue for the same feature request?

• [X] I have checked the existing issues.

需求描述： ○监控：refresh 次数（成功次数、失败次数、总次数） ○历史记录： ■开始时间、结束时间、插入行数、状态 ■refresh action：增量、全量（暂无）、no data（暂无） ■refresh trigger：rows、time、手动（暂无） ○操作 ■暂停：不听 kafka 数据，也不 refresh dt ■开始：控制暂停期间堆积的数据 push 的量的节奏

Is your feature request related to a problem?

No response

Describe the feature you'd like

Right now, DT data is incremental adding only since it is based on the Kafka.

Still. we need a mechanism to validate that we have calculated all kafka messages correctly.

So need to add a validation mechanism to verify and in case of failure, be able to rollback and recalculate.

Describe implementation you've considered

No response

Documentation, Adoption, Use Case, Migration Strategy

No response

Additional information

No response

[dengn]

@yangj1211 please verify the user behavior with @gavinyue before doc editing.

[qingxinhome]

Pending processing

[qingxinhome]

Pending processing