search

DTStack / chunjun

A data integration framework
https://dtstack.github.io/chunjun/
Apache License 2.0
3.98k stars 1.69k forks source link

[Bug] [dirty] 配置了脏数据处理，Prometheus nErrors指标不能同步最后一次失败的次数 #1832

Closed tangguol closed 11 months ago

tangguol commented 12 months ago

Search before asking

What happened

Prometheus nErrors指标不能同步最后一次失败的次数

What you expected to happen

nErrors指标能正常显示失败数据

How to reproduce

  1. 配置oracel表同步oracle表
  2. 开启脏数据mysql ， 配置 chunjun.dirty-data.max-rows=3
  3. 开启指标同步
  4. 造脏数据
  5. 当我们造3条脏数据时候，在Prometheus平台查flink_taskmanager_job_task_operator_chunjun_nErrors指标值为2。但在mysql脏数据表中已经有3条记录。
  6. 预期nErrors 也是3条记录

Anything else

No response

Version

master

Are you willing to submit PR?

Code of Conduct