search

sni / lmd

Livestatus Multitool Daemon - Create livestatus federation from multiple sources
https://labs.consol.de/omd/packages/lmd/
GNU General Public License v3.0
42 stars 31 forks source link

services delta scan timestamp filter too complex #124

Closed bjornfro closed 1 year ago

bjornfro commented 2 years ago

Not really an issue but more of a question what below means. It's from an idle LMD not gone live yet.

[2022-04-10 03:05:48.641][Warn][pid:45109][datastoreset:436] [sesslx04-sesblx04][r:565d49] services delta scan timestamp filter too complex: 950 [2022-04-10 03:35:49.118][Warn][pid:45109][datastoreset:436] [sesslx04-sesblx04][r:6aaed8] services delta scan timestamp filter too complex: 723 [2022-04-10 04:05:48.617][Warn][pid:45109][datastoreset:436] [sesslx04-sesblx04][r:a3a602] services delta scan timestamp filter too complex: 961 [2022-04-10 04:35:48.640][Warn][pid:45109][datastoreset:436] [sesslx04-sesblx04][r:23f782] services delta scan timestamp filter too complex: 729 [2022-04-10 05:05:48.672][Warn][pid:45109][datastoreset:436] [sesslx04-sesblx04][r:f5286d] services delta scan timestamp filter too complex: 976 [2022-04-10 05:35:48.653][Warn][pid:45109][datastoreset:436] [sesslx04-sesblx04][r:b0df2a] services delta scan timestamp filter too complex: 730 [2022-04-10 06:05:48.638][Warn][pid:45109][datastoreset:436] [sesslx04-sesblx04][r:8ee0d2] services delta scan timestamp filter too complex: 969 [2022-04-10 06:35:48.677][Warn][pid:45109][datastoreset:436] [sesslx04-sesblx04][r:978c04] services delta scan timestamp filter too complex: 720 [2022-04-10 07:05:48.680][Warn][pid:45109][datastoreset:436] [sesslx04-sesblx04][r:b670eb] services delta scan timestamp filter too complex: 974 [2022-04-10 07:35:48.625][Warn][pid:45109][datastoreset:436] [sesslx04-sesblx04][r:a9eacb] services delta scan timestamp filter too complex: 725

sni commented 2 years ago

What kind of backend is this? If it's a naemon backend, it might tell you there is something wrong with the clock of the lmd or backend system. Basically this message means there are a lot of services slipped through the normal periodic update and had to be synchronized separately. When using naemon, this should not happen and tells you there is something wrong. When not using naemon, this ok, because there is no way to make it more efficient. In this i should lower the log level, because a warning might be irritating.

bjornfro commented 2 years ago

This is naemon livestatus TCP backend. Both nodes are timesynched with NTP and that looks OK. LMD is running on one node and naemon on another. This error message is not very frequent. System is not really live yet, so does not have a lot of queries. Not sure if that matters.

[2022-04-11 08:50:02.607][Warn][pid:56207][datastoreset:436] [sesslx04-sesblx04][r:6ada82] services delta scan timestamp filter too complex: 897 [2022-04-11 08:50:02.720][Warn][pid:56207][datastoreset:436] [sesslx04-sesblx04][r:181360] services delta scan timestamp filter too complex: 897 [2022-04-11 11:20:02.221][Warn][pid:56207][datastoreset:436] [sesslx04-sesblx04][r:ec7df1] services delta scan timestamp filter too complex: 513 [2022-04-11 11:20:02.238][Warn][pid:56207][datastoreset:436] [sesslx04-sesblx04][r:3b86eb] services delta scan timestamp filter too complex: 513 [2022-04-11 11:50:02.791][Warn][pid:56207][datastoreset:436] [sesslx04-sesblx04][r:34ccea] services delta scan timestamp filter too complex: 908 [2022-04-11 12:13:09.254][Warn][pid:56207][datastoreset:436] [sesslx04-sesblx04][r:d10a73] services delta scan timestamp filter too complex: 711 [2022-04-11 12:13:09.328][Warn][pid:56207][datastoreset:436] [sesslx04-sesblx04][r:34c416] services delta scan timestamp filter too complex: 711

crodriguezgarci commented 2 years ago

Hi! Same here using lmd fetching from other lmd fetching from Shinken:

[2022-06-13 14:02:43.215][Info][pid:32134][peer:624] [shinken-python3] switched to idle interval, last query: never (idle timeout: 120) [2022-06-13 14:32:35.204][Warn][pid:32134][datastoreset:436] [wocu-devel-wocus-hg][r:a5d2d6] services delta scan timestamp filter too complex: 375 [2022-06-13 14:32:35.214][Warn][pid:32134][datastoreset:436] [wocu-devel-test-hg][r:9ffb4c] services delta scan timestamp filter too complex: 375 [2022-06-13 14:32:35.233][Warn][pid:32134][datastoreset:436] [naturgy][r:6b39c1] services delta scan timestamp filter too complex: 375 [2022-06-13 14:32:35.464][Warn][pid:32134][datastoreset:436] [espana][r:9ec05d] services delta scan timestamp filter too complex: 375 [2022-06-13 14:32:35.498][Warn][pid:32134][datastoreset:436] [RE1][r:cd2653] services delta scan timestamp filter too complex: 375 [2022-06-13 14:32:35.538][Warn][pid:32134][datastoreset:436] [RE13][r:a50888] services delta scan timestamp filter too complex: 375 [2022-06-13 14:32:35.626][Warn][pid:32134][datastoreset:436] [wocus monica][r:0c2e39] services delta scan timestamp filter too complex: 375 [2022-06-13 14:32:35.638][Warn][pid:32134][datastoreset:436] [wocu-test-wocus][r:4c8dcb] services delta scan timestamp filter too complex: 375 [2022-06-13 14:32:35.660][Warn][pid:32134][datastoreset:436] [wocu-devel-prueba-telefonica][r:daa8d5] services delta scan timestamp filter too complex: 375

sni commented 1 year ago

i think this should be better since 7b5124be1221afc96e783a6166134d6b64eeceda please reopen if the issue still persists.