Error "[ZMQCollectorInterface.cpp:475] ERROR: Uncompress error"

[earendilfr]

Environment:

• OS name: Rocky Linux/docker
• OS version: 8.9/24.0.7
• Architecture: amd64
• ntopng version/revision:

  Version:        6.2.240814 [Enterprise/Professional build]
  GIT rev:        6.2-stable:9a35ae52a1976b4df9c8eecd039dfac8ef7371ba:20240814
  Pro rev:        r6767
  Built on:       Ubuntu 24.04 LTS

• nprobe version/revision:

  Version:       10.6.240814
  Build OS:      Ubuntu 24.04 LTS
  SystemID:      L68B83E3F92066B1F--U68B83E3FD51F4B47--OL
  GIT rev:       10.6-stable:e617f2729589af3a50b10fc4d31ccc34f1f3ff35:20240814

What happened:

When I start the ntopng after an upgrade, I have the following error:

05/Sep/2024 11:00:52 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3452]
05/Sep/2024 11:00:57 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3483]
05/Sep/2024 11:01:02 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3451]
05/Sep/2024 11:01:07 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3457]
05/Sep/2024 11:01:12 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3473]
05/Sep/2024 11:01:17 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3477]
05/Sep/2024 11:01:22 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3464]

How did you reproduce it?

Start the docker compose and automatically, we seen this error

Debug Information:

• For docker

  05/Sep/2024 11:05:47 [main.cpp:450] Working directory: /var/lib/ntopng
  05/Sep/2024 11:05:47 [main.cpp:452] Scripts/HTML pages directory: /usr/share/ntopng
  05/Sep/2024 11:05:47 [Ntop.cpp:547] Welcome to ntopng x86_64 v.6.2.240814 (6.2-stable:9a35ae52a1976b4df9c8eecd039dfac8ef7371ba:20240814)
  05/Sep/2024 11:05:47 [Ntop.cpp:556] Built on Ubuntu 24.04 LTS
  05/Sep/2024 11:05:47 [Ntop.cpp:558] (C) 1998-24 ntop
  05/Sep/2024 11:05:47 [NtopPro.cpp:915] [LICENSE] xxxxx
  05/Sep/2024 11:05:47 [MySQLDB.cpp:949] Successfully connected to ClickHouse [ntopng@127.0.0.1:9004][dbname: <no db>] for interface __system__
  05/Sep/2024 11:05:47 [PeriodicActivities.cpp:122] Started periodic activities loop...
  05/Sep/2024 11:05:48 [startup.lua:37] Processing startup.lua: please hold on...
  05/Sep/2024 11:05:48 [startup.lua:41] [startup.lua:27] Started Top Sites aggregation
  05/Sep/2024 11:05:48 [startup.lua:41] [startup.lua:30] Top Sites aggregation done
  05/Sep/2024 11:05:48 [startup.lua:41] [clickhouse_retention.lua:69] Performing Clickhouse cleanup
  05/Sep/2024 11:05:48 [startup.lua:41] [clickhouse_retention.lua:96] Clickhouse cleanup completed
  05/Sep/2024 11:05:48 [startup.lua:41] [asset_inventory.lua:49] [Asset Inventory] Initalization...
  05/Sep/2024 11:05:48 [startup.lua:41] [asset_inventory_db.lua:23] [Asset Inventory DB] Initialization completed
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:843] Refreshing category lists...
  Unable to open file /etc/ntopng/protos [Permission denied]
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:629] Loaded Abuse.ch URLhaus: 225 rules
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:629] Loaded ELLIO: Community Feed (for non-commercial use): 161916 rules
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:629] Loaded Emerging Threats: 1377 rules
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:629] Loaded IPsum Threat Intelligence Feed: 31341 rules
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:629] Loaded NoCoin Filter List: 409 rules
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:629] Loaded SSLBL Botnet C2 IP Blacklist: 56 rules
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:629] Loaded Stratosphere Lab: 11670 rules
  [/var/lib/ntopng/category_lists/ThreatFox.txt]valid line format or private IP 127.0.0.1        service-hh4fmtad-1321953982.sh.tencentapigw.com/
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:629] Loaded ThreatFox: 7525 rules
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:629] Loaded dshield 7 days: 29 rules
  05/Sep/2024 11:05:49 [startup.lua:123] [lists_utils.lua:740] Loaded Category Lists (8159 hosts, 206389 IPs, 0 JA3) loaded in 0 sec
  05/Sep/2024 11:05:49 [startup.lua:127] Initializing device polices...
  05/Sep/2024 11:05:49 [startup.lua:143] Initializing alerts...
  05/Sep/2024 11:05:49 [startup.lua:152] Initializing timeseries...
  05/Sep/2024 11:05:49 [startup.lua:210] Importing ClickHouse dumps...
  05/Sep/2024 11:05:49 [startup.lua:253] Completed startup.lua
  05/Sep/2024 11:05:49 [FlowChecksLoader.cpp:296] WARNING: Unable to find flow check 'remote_to_local_insecure_proto': skipping it
  05/Sep/2024 11:05:50 [NetworkInterface.cpp:3819] Started packet polling on interface 'tcp://127.0.0.1:5556c' [id: 33]...
  05/Sep/2024 11:05:51 [ZMQCollectorInterface.cpp:263] Collecting flows on tcp://127.0.0.1:5556c
  05/Sep/2024 11:05:51 [ParserInterface.cpp:104] Flow dropped due to limits to the license. Exporters limit: 16 | Exporters Interfaces limit: 256
  05/Sep/2024 11:05:51 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3551]
  05/Sep/2024 11:05:52 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3534]
  05/Sep/2024 11:05:57 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3536]
  05/Sep/2024 11:06:02 [ZMQCollectorInterface.cpp:475] ERROR: Uncompress error [-5][len: 3525]

[earendilfr]

I see in ticket #8694 that there is a version 10.7.x... But currently, the last version published on docker hub is the 10.6.x.

Did I need to use the ntopng.dev temporary to solve this issue ?

[lucaderi]

Docker image updated. Please update and report if not working (update both ntopng and nProbe) reopening this ticket.

[earendilfr]

Perfect: the error message disappear. Thanks a lot