LogiKM对接夜莺监控时告警规则无效的问题

PengShuaixin commented 3 years ago

问题描述

在KM里面成功创建告警规则的情况下，夜莺监控系统里面在达到触发规则的情况下，不能正常报警

原因初步分析

分析方法com.xiaojukeji.kafka.manager.monitor.component.n9e.N9eService#sinkMetrics中的请求发给夜莺的监控指标，数据如下：

[{"metric":"online-kafka-topic-msgIn","nid":"1","step":60,"tags":"cluster=TAGTIC_KAFKA,topic=events","timestamp":1626337144,"value":0.0},{"metric":"online-kafka-topic-bytesIn","nid":"1","step":60,"tags":"cluster=TAGTIC_KAFKA,topic=events","timestamp":1626337144,"value":0.0},{"metric":"online-kafka-topic-bytesRejected","nid":"1","step":60,"tags":"cluster=TAGTIC_KAFKA,topic=events","timestamp":1626337144,"value":0.0},{"metric":"online-kafka-topic-msgIn","nid":"1","step":60,"tags":"cluster=TAGTIC_KAFKA,topic=__consumer_offsets","timestamp":1626337144,"value":2.964393875E-314},{"metric":"online-kafka-topic-bytesIn","nid":"1","step":60,"tags":"cluster=TAGTIC_KAFKA,topic=__consumer_offsets","timestamp":1626337144,"value":2.964393875E-314},{"metric":"online-kafka-topic-bytesRejected","nid":"1","step":60,"tags":"cluster=TAGTIC_KAFKA,topic=__consumer_offsets","timestamp":1626337144,"value":0.0}]

如上数据，我们能看到tags里面的数据为cluster=TAGTIC_KAFKA;

再看com.xiaojukeji.kafka.manager.monitor.component.n9e.N9eService#createStrategy方法，发现向夜莺发送创建告警规则时，请求数据如下：

{"alert_dur":60,"alert_upgrade":{"duration":60,"groups":[],"level":1,"users":[]},"callback":"","category":2,"converge":[300,1],"enable_days_of_week":[0,1,2,3,4,5,6,7],"enable_etime":"23:59","enable_stime":"00:00","excl_nid":[],"exprs":[{"eopt":"<","func":"all","metric":"online-kafka-topic-msgIn","params":[1],"threshold":0}],"name":"测试-A","need_upgrade":0,"nid":1,"notify_group":[1],"notify_user":[],"priority":3,"recovery_dur":0,"recovery_notify":0,"tags":[{"tkey":"topic","topt":"=","tval":["events"]},{"tkey":"cluster","topt":"=","tval":["内网集群"]}]}

如上数据，发现{"tkey":"cluster","topt":"=","tval":["内网集群"]}中cluster的标签值为内网集群;

其中，TAGTIC_KAFKA和内网集群的关系在KM中如图：