elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.8k stars 8.19k forks source link

[Security Solution][Detections] Enhance UX when Security ML Jobs automatically stop due to lack of data #100506

Open spong opened 3 years ago

spong commented 3 years ago

The Security Solution ML Jobs make use of the max_empty_searches configuration, which means:

If a real-time datafeed has never seen any data (including during any initial training period) then it will automatically stop itself and close its associated job after this many real-time searches that return no documents. In other words, it will stop after frequency times max_empty_searches of real-time operation. If not set then a datafeed with no end time that sees no data will remain started until it is explicitly stopped. By default this setting is not set.

The special value -1 unsets this setting.

As a result, users Security ML Jobs may automatically stop and it may not be clear to them as why this may be occurring, or how to mitigate.

This enhancement is for improving the UI/UX around this behavior, which may include:

elasticmachine commented 3 years ago

Pinging @elastic/security-solution (Team: SecuritySolution)

elasticmachine commented 3 years ago

Pinging @elastic/security-detections-response (Team:Detections and Resp)