In New Relic there are many repeated logs like Removed node *. and Registered new node *.. That indicates that either the API server or Redis was too slow to update at the expected frequency.
Most likely that is the reason why some probes are offline on the dashboard from time to time:
Worker can't sync with a external node -> removes it's nodes from fetchProbes -> AdoptedProbes syncs missing probes as offline.
In New Relic there are many repeated logs like
Removed node *.
andRegistered new node *.
. That indicates that either the API server or Redis was too slow to update at the expected frequency.Most likely that is the reason why some probes are offline on the dashboard from time to time: Worker can't sync with a external node -> removes it's nodes from fetchProbes -> AdoptedProbes syncs missing probes as offline.