ntop / ntopng

Web-based Traffic and Security Network Traffic Monitoring
http://www.ntop.org
GNU General Public License v3.0
6.3k stars 656 forks source link

Some list download failed #8029

Closed vuanhson closed 1 year ago

vuanhson commented 1 year ago

Environment:

What happened: Some list failed to download

How did you reproduce it? docker compose up the ntopng image and then docker compose logs

Debug Information: From docker compose logs

ntopng  | 19/Nov/2023 11:42:13 [PeriodicActivities.cpp:108] Started periodic activities loop...
ntopng  | 19/Nov/2023 11:42:13 [startup.lua:38] Processing startup.lua: please hold on...
ntopng  | 19/Nov/2023 11:42:13 [startup.lua:121] [lists_utils.lua:831] Refreshing category lists...
ntopng  | 19/Nov/2023 11:42:13 [startup.lua:121] [lists_utils.lua:679] List 'Stratosphere Lab' has 0 rules. Please report this to https://github.com/ntop/ntopng
ntopng  | 19/Nov/2023 11:42:14 [startup.lua:121] [lists_utils.lua:466] Failure loading host '56565' category '100' in list 'ThreatFox'
ntopng  | 19/Nov/2023 11:42:14 [startup.lua:121] [lists_utils.lua:466] Failure loading host 'noluyoruzawk' category '100' in list 'ThreatFox'
ntopng  | 19/Nov/2023 11:42:14 [startup.lua:121] [lists_utils.lua:466] Failure loading host '4040' category '100' in list 'ThreatFox'
ntopng  | 19/Nov/2023 11:42:14 [startup.lua:121] [lists_utils.lua:466] Failure loading host 'datacikerim' category '100' in list 'ThreatFox'
ntopng  | 19/Nov/2023 11:42:14 [startup.lua:121] [lists_utils.lua:466] Failure loading host 'nicehash' category '100' in list 'ThreatFox'
ntopng  | 19/Nov/2023 11:42:14 [startup.lua:121] [lists_utils.lua:466] Failure loading host 'mpapwpodllalw' category '100' in list 'ThreatFox'
ntopng  | 19/Nov/2023 11:42:14 [startup.lua:121] [lists_utils.lua:466] Failure loading host 'makelovenotmalware.local' category '100' in list 'ThreatFox'
ntopng  | 19/Nov/2023 11:42:14 [startup.lua:121] [lists_utils.lua:466] Failure loading host 'lwwfechxdr8aiq0bbhtrxry7i1c8itnz' category '100' in list 'ThreatFox'
ntopng  | 19/Nov/2023 11:42:14 [startup.lua:121] [lists_utils.lua:466] Failure loading host 'ddkkba0zqra9dtqunixbqaa8olgtkc5j' category '100' in list 'ThreatFox'
ntopng  | 19/Nov/2023 11:42:14 [startup.lua:121] [lists_utils.lua:753] Category Lists (25828 hosts, 1139 IPs, 0 JA3) loaded in 1 sec
MatteoBiscosi commented 1 year ago

Hi @vuanhson , I checked all the loading failure we have and the issue is with the format of those hosts in the ThreatFox file that is not correct, so we cannot do much about it, it is a ThreatFox issue