humio / issues

Issue Tracker for Humio
4 stars 2 forks source link

False positive alerts sent in a loop #112

Open wknapik opened 4 years ago

wknapik commented 4 years ago

Hi,

On Humio Cloud v1.6.5, we're getting repeated false-positive email alerts for a few days now. This was also reported via email.

When the "Open in Humio" link is clicked, the page does not display any hits - there are no results for the query. For queries with groupby, there are no grouped items to select on the left and for other queries, there's just no matching log lines.

This is producing a lot of emails and skews our signal/noise ratio to nearly zero, at least for humio-based alerts. Please look into it.

andejens commented 4 years ago

Hi @wknapik I see you already opened a support ticket for this - we are getting back to you through our support channel. We will treat it as high priority.

andejens commented 4 years ago

I'll keep this open until we have fixed the issue.

wknapik commented 4 years ago

Hi @andejens. That support ticket was opened by my colleague, who's not at work until Monday, so if you have any updates before then, please leave them here. Otherwise the email route will be fine next week. Thanks.

andejens commented 4 years ago

Understood - we have developed a fix that is currently undergoing testing.

wknapik commented 4 years ago

Hi @andejens. Things are way better now, but I still got a false positive a moment ago (message id 4da703be-96cc-4c73-820d-390417773405@mtasv.net).