ccfos / nightingale

An all-in-one observability solution which aims to combine the advantages of Prometheus and Grafana. It manages alert rules and visualizes metrics, logs, traces in a beautiful web UI.
https://flashcat.cloud/docs/
Apache License 2.0
9.56k stars 1.4k forks source link

发送消息过多的时候,会触发告警媒介机器人的限制,导致消息收不到 #1437

Closed jicki closed 1 year ago

jicki commented 1 year ago

Relevant server.conf | webapi.conf

none

Relevant logs

2023-03-22 10:42:44.973097 INFO sender/feishu.go:80 feishu_sender: result=succ url=https://open.feishu.cn/open-apis/bot/v2/hook/b43e7bea-88fd-436e-xxxx-xxxxxxxxxx code=400 response={"code":9499,"msg":"too many request","data":{}}
2023-03-22 10:42:44.974150 INFO sender/feishu.go:80 feishu_sender: result=succ url=https://open.feishu.cn/open-apis/bot/v2/hook/b43e7bea-88fd-436e-xxxx-xxxxxxxxxx code=400 response={"code":9499,"msg":"too many request","data":{}}
2023-03-22 10:42:44.974198 INFO sender/feishu.go:80 feishu_sender: result=succ url=https://open.feishu.cn/open-apis/bot/v2/hook/b43e7bea-88fd-436e-xxxx-xxxxxxxxxx code=400 response={"code":9499,"msg":"too many request","data":{}}
2023-03-22 10:42:44.975050 INFO sender/feishu.go:80 feishu_sender: result=succ url=https://open.feishu.cn/open-apis/bot/v2/hook/b43e7bea-88fd-436e-xxxx-xxxxxxxxxx code=400 response={"code":9499,"msg":"too many request","data":{}}
2023-03-22 10:42:44.975275 INFO sender/feishu.go:80 feishu_sender: result=succ url=https://open.feishu.cn/open-apis/bot/v2/hook/b43e7bea-88fd-436e-xxxx-xxxxxxxxxx code=400 response={"code":9499,"msg":"too many request","data":{}}
2023-03-22 10:42:44.975308 INFO sender/feishu.go:80 feishu_sender: result=succ url=https://open.feishu.cn/open-apis/bot/v2/hook/b43e7bea-88fd-436e-xxxx-xxxxxxxxxx code=400 response={"code":9499,"msg":"too many request","data":{}}
2023-03-22 10:42:44.975579 INFO sender/feishu.go:80 feishu_sender: result=succ url=https://open.feishu.cn/open-apis/bot/v2/hook/b43e7bea-88fd-436e-xxxx-xxxxxxxxxx code=400 response={"code":9499,"msg":"too many request","data":{}}


### System info

v6 beta5

### Steps to reproduce

1. 飞书机器人 触发的限制是 5条每秒
2. 告警超过5条每秒的话
...

### Expected behavior

预期是可以收到消息.

1. 在 AlertManager 里面有 Group 的概念,可以将同一个时间段,或者 相同 labels 的定义为一个组,将多条消息合并成一条发送. 

2. 或者可以定义发送的频率

### Actual behavior

none

### Additional info

_No response_
UlricQin commented 1 year ago

开源版本产品上没有计划做聚合发送。如果需要的话可以试用FlashDuty:https://console.flashcat.cloud/