nfcapd / nfprofile nfcapd.JJJJMMDDHHMM: File not found!

Takalele commented 1 month ago

Hi,

I am in the process of migrating from my old nfdump (v1.6.18) and nfsen (v1.3.6p1) installation to the latest available source versions of both tools.

Currently, I have configured the new nfdump installation to export to the old setup via the -R IP/Port option, allowing me to compare the two installations.

However, I am encountering an issue where nfprofile occasionally fails to find the corresponding nfcapd files. The error message looks like this:

local3.error: nfprofile[260982]: stat() error '/data/nfsen/profiles-data/live/device/nfcapd.202409041235': File not found!

The strange part is that the file does exist, but in a different directory:

ll /data/nfsen/profiles-data/live/device/2024/09/04/nfcapd.202409041235
-rw-r--r--. 1 abc www-data 70097028 Sep  4 12:40 /data/nfsen/profiles-data/live/device/2024/09/04/nfcapd.202409041235

From my perspective, it seems that the file is being moved before nfprofile has a chance to access it. This issue occurs randomly and affects all custom profiles.

old installation: old

new installation: new

Do you have any advice or suggestions on how to resolve this issue?

thank you and BR Takalele

phaag commented 1 month ago

As of the file not found - it looks like the Subdir values are not identical from old with new installation. Please make sure they fit. Otherwise you have errors like these.

As of the dropouts - Just from the picture itself, this is difficult to debug. You need to check your log files.

Takalele commented 1 month ago

hi @phaag

What do you mean by Subdir values?

The device names? (For the most part, they are the same, but we had to replace the '-' with '_' for certain devices.) The SUBDIRLAYOUT? (It's identical.) Apart from nfsen[493]: Run nfdump failed: Exit: 1, Signal: 0, Coredump: 0 and local3.error: nfprofile[13749]: stat() error '/data/nfsen/profiles-data/live/fw5_context1/nfcapd.202409041100': File not found!, the logs look good.

I've tried to comple nfdump with the --enable-devel flag for more logs but it fails to compile

49.97 Making all in src/nfdump
49.98 make[2]: Entering directory '/src/nfdump/src/nfdump'
49.98 depbase=`echo nfdump.o | sed 's|[^/]*$|.deps/&|;s|\.o$||'`;\
49.98 gcc -DHAVE_CONFIG_H -I. -I../..  -I.. -Icompat_1_6_x -I../include -I../libnffile -I../libnfdump -I../output -I../tor -I../netflow -I../collector -I../inline    -g -O3 -std=gnu17 -Wall -Wstrict-prototypes -Wmissing-prototypes -Wmissing-declarations -Wmissing-noreturn -fno-strict-aliasing -DDEVEL -DNSEL -DBUILDTOR -pthread -MT nfdump.o -MD -MP -MF $depbase.Tpo -c -o nfdump.o nfdump.c &&\
49.98 mv -f $depbase.Tpo $depbase.Po
50.03 In file included from ../libnffile/flist.h:38,
50.03                  from nfdump.c:59:
50.03 nfdump.c: In function ‘filterThread’:
50.03 nfdump.c:488:93: error: ‘recordCounter’ undeclared (first use in this function); did you mean ‘RecordPrinter_t’?
50.03   488 |     dbg_printf("FilterThread %d done. blocks: %u records: %" PRIu64 " \n", self, numBlocks, recordCounter);
50.03       |                                                                                             ^~~~~~~~~~~~~
50.03 ../libnffile/util.h:46:32: note: in definition of macro ‘dbg_printf’
50.03    46 | #define dbg_printf(...) printf(__VA_ARGS__)
50.03       |                                ^~~~~~~~~~~
50.03 nfdump.c:488:93: note: each undeclared identifier is reported only once for each function it appears in
50.03   488 |     dbg_printf("FilterThread %d done. blocks: %u records: %" PRIu64 " \n", self, numBlocks, recordCounter);
50.03       |                                                                                             ^~~~~~~~~~~~~
50.03 ../libnffile/util.h:46:32: note: in definition of macro ‘dbg_printf’
50.03    46 | #define dbg_printf(...) printf(__VA_ARGS__)
50.03       |                                ^~~~~~~~~~~
50.05 make[2]: *** [Makefile:479: nfdump.o] Error 1
50.05 make[2]: Leaving directory '/src/nfdump/src/nfdump'
50.05 make[1]: Leaving directory '/src/nfdump'
50.05 make[1]: *** [Makefile:436: all-recursive] Error 1
50.05 make: *** [Makefile:368: all] Error 2

nfcapd/nfprofile log:

daemon.info: nfcapd[287]: Ident: 'fw1' Flows: 0, Packets: 0, Bytes: 0, Sequence Errors: 80965, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[287]: Total packets received: 170078 avg: 566.93 ignored packets: 0
daemon.info: nfcapd[332]: Ident: 'fw2' Flows: 0, Packets: 0, Bytes: 0, Sequence Errors: 237, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[332]: Total packets received: 214549 avg: 715.16 ignored packets: 0
daemon.info: nfcapd[341]: Ident: 'fw3_context1' Flows: 0, Packets: 0, Bytes: 0, Sequence Errors: 103, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[341]: Total packets received: 46736 avg: 155.79 ignored packets: 0
daemon.info: nfcapd[390]: Ident: 'dc_router1' Flows: 0, Packets: 0, Bytes: 0, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[390]: Total packets received: 3585 avg: 11.95 ignored packets: 0
daemon.info: nfcapd[277]: Ident: 'fw3_context2' Flows: 0, Packets: 0, Bytes: 0, Sequence Errors: 39, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[277]: Total packets received: 56146 avg: 187.15 ignored packets: 0
daemon.info: nfcapd[447]: Ident: 'router1' Flows: 521992, Packets: 122903743, Bytes: 111601757392, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[447]: Total packets received: 26708 avg: 89.03 ignored packets: 0
daemon.info: nfcapd[314]: Ident: 'router2' Flows: 161550, Packets: 15477297, Bytes: 10030180466, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[314]: Total packets received: 13325 avg: 44.42 ignored packets: 0
daemon.info: nfcapd[323]: Ident: 'dc_router2' Flows: 0, Packets: 0, Bytes: 0, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[323]: Total packets received: 5699 avg: 19.00 ignored packets: 0
daemon.info: nfcapd[296]: Ident: 'fw4_context1' Flows: 144, Packets: 536, Bytes: 69760, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[296]: Total packets received: 47 avg: 0.16 ignored packets: 0
daemon.error: nfcapd[257]: Ident: fw5_context1, Can't rename dump file: No such file or directory
daemon.info: nfcapd[257]: Ident: 'fw5_context1' Flows: 0, Packets: 0, Bytes: 0, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[257]: Total packets received: 0 avg: 0.00 ignored packets: 0
daemon.info: nfcapd[438]: Ident: 'fw4_context2' Flows: 0, Packets: 0, Bytes: 0, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[438]: Total packets received: 54 avg: 0.18 ignored packets: 0
daemon.info: nfcapd[305]: Ident: 'fw5_context2' Flows: 0, Packets: 0, Bytes: 0, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
daemon.info: nfcapd[305]: Total packets received: 0 avg: 0.00 ignored packets: 0
local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 13745

local3.debug: nfsen[13745]: Cmd Decode: signal

local3.debug: nfsen[13745]: Cmd Decode: quit

local3.debug: nfsen[493]: Signal 'start-periodic'

local3.debug: nfsen[493]: Run periodic at Wed Sep  4 11:05:00 2024

local3.debug: nfsen[493]: Prepare profiling './AS'

local3.debug: nfsen[493]: Prepare profiling './TorNetworkTraffic'

local3.debug: nfsen[493]: Prepare profiling './destination_US'

local3.debug: nfsen[493]: Prepare profiling './live'

local3.debug: nfsen[493]: Prepare profiling './real'

local3.debug: nfsen[493]: Prepare profiling 'Geolocation/by_continents'

local3.debug: nfsen[493]: Prepare profiling 'Geolocation/by_country'

local3.debug: nfsen[493]: Prepare profiling 'Geolocation/by_eu'

local3.debug: nfsen[493]: Prepare profiling 'forensik/SECCAM'

local3.debug: nfsen[493]: Prepare profiling 'network/Backup'

local3.debug: nfsen[493]: Prepare profiling 'network/RDEPLOYMENT'

local3.debug: nfsen[493]: Prepare profiling 'network/ICMP-flood'

local3.debug: nfsen[493]: Prepare profiling 'network/MS-Teams'

local3.debug: nfsen[493]: Prepare profiling 'network/NFS'

local3.debug: nfsen[493]: Prepare profiling 'network/SAMBA'

local3.debug: nfsen[493]: Prepare profiling 'network/SQL'

local3.debug: nfsen[493]: Prepare profiling 'network/Strange-behavior'

local3.debug: nfsen[493]: Prepare profiling 'network/Streaming-Lasttests'

local3.debug: nfsen[493]: Prepare profiling 'network/US-Drei-WLANCall'

local3.debug: nfsen[493]: Prepare profiling 'network/US-IPv6'

local3.debug: nfsen[493]: Prepare profiling 'network/US-Magenta'

local3.debug: nfsen[493]: Prepare profiling 'network/US-Mail'

local3.debug: nfsen[493]: Prepare profiling 'network/US-Multicast'

local3.debug: nfsen[493]: Prepare profiling 'network/US-NextLayer'

local3.debug: nfsen[493]: Prepare profiling 'network/US-QOS'

local3.debug: nfsen[493]: Prepare profiling 'network/US-SIL'

local3.debug: nfsen[493]: Prepare profiling 'network/US-Telekom'

local3.debug: nfsen[493]: Prepare profiling 'network/US-WiredWireless-Outside'

local3.debug: nfsen[493]: Prepare profiling 'network/US-Wireless'

local3.debug: nfsen[493]: Prepare profiling 'network/US-Phone-Server'

local3.info: nfsen[493]: 158 channels/alerts to profile

local3.debug: nfsen[494]: comm child[13745] terminated with no exit value

local3.debug: nfsen[13746]: profile opts: .#AS#2#amazon#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13746]: profile opts: .#AS#2#akamai#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13746]: profile opts: .#AS#2#microsoft#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13746]: profile opts: .#TorNetworkTraffic#2#src_IP_TOR#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13746]: profile opts: .#destination_US#2#Source_Internet#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13746]: profile opts: .#real#2#fw1#fw1 for profiler 0

local3.debug: nfsen[13746]: profile opts: .#real#2#fw3_context1#fw3_context1 for profiler 0

local3.debug: nfsen[13746]: profile opts: .#real#2#router2#router2 for profiler 0

local3.debug: nfsen[13746]: profile opts: .#real#2#router1#router1 for profiler 0

local3.debug: nfsen[13746]: profile opts: Geolocation#by_continents#2#Asia#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13746]: profile opts: Geolocation#by_continents#2#South_America#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13746]: profile opts: Geolocation#by_continents#2#North_America#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13746]: profile opts: Geolocation#by_country#2#USA#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13748]: profile opts: .#AS#2#US#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: Geolocation#by_country#2#OtherCountries#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13746]: profile opts: Geolocation#by_eu#2#None_EU_Members#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#Backup#2#fw2#fw2 for profiler 0

local3.debug: nfsen[13748]: profile opts: .#AS#2#google#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#Backup#2#fw3_context1#fw3_context1 for profiler 0

local3.debug: nfsen[13748]: profile opts: .#AS#2#netflix#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#Backup#2#router2#router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: .#AS#2#aconet#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#Backup#2#dc_router2#dc_router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: .#TorNetworkTraffic#2#dst_IP_TOR#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#RDEPLOYMENT#2#router1#router1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#RDEPLOYMENT#2#router2#router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: .#real#2#fw2#fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#RDEPLOYMENT#2#fw3_context2#fw3_context2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#RDEPLOYMENT#2#dc_router1#dc_router1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#RDEPLOYMENT#2#fw4_context2#fw4_context2 for profiler 0

local3.debug: nfsen[13748]: profile opts: .#real#2#dc_router1#dc_router1 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#ICMP-flood#2#fw1#fw1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#ICMP-flood#2#fw2#fw2 for profiler 0

local3.debug: nfsen[13748]: profile opts: .#real#2#fw3_context2#fw3_context2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#ICMP-flood#2#router2#router2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#ICMP-flood#2#fw3_context1#fw3_context1 for profiler 0

local3.debug: nfsen[13748]: profile opts: .#real#2#dc_router2#dc_router2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#ICMP-flood#2#router1#router1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#MS-Teams#2#fw4_context1#fw4_context1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#MS-Teams#2#fw3_context2#fw3_context2 for profiler 0

local3.debug: nfsen[13748]: profile opts: Geolocation#by_continents#2#Antarctica#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#MS-Teams#2#dc_router1#dc_router1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#MS-Teams#2#dc_router2#dc_router2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#MS-Teams#2#fw4_context2#fw4_context2 for profiler 0

local3.debug: nfsen[13748]: profile opts: Geolocation#by_continents#2#Africa#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#NFS#2#fw1#fw1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#NFS#2#fw2#fw2 for profiler 0

local3.debug: nfsen[13748]: profile opts: Geolocation#by_continents#2#Oceania#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#NFS#2#router2#router2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#NFS#2#dc_router1#dc_router1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#NFS#2#router1#router1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#SAMBA#2#fw3_context1#fw3_context1 for profiler 0

local3.debug: nfsen[13748]: profile opts: Geolocation#by_continents#2#Europe#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#SAMBA#2#fw4_context1#fw4_context1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#SAMBA#2#fw3_context2#fw3_context2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#SAMBA#2#router1#router1 for profiler 0

local3.debug: nfsen[13748]: profile opts: Geolocation#by_country#2#Austria#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#SAMBA#2#fw4_context2#fw4_context2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#SQL#2#router1#router1 for profiler 0

local3.debug: nfsen[13748]: profile opts: Geolocation#by_country#2#Germany#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#Strange-behavior#6#router1#router1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#Strange-behavior#6#fw3_context2#fw3_context2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#Strange-behavior#6#router2#router2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#Strange-behavior#6#fw3_context1#fw3_context1 for profiler 0

local3.debug: nfsen[13748]: profile opts: Geolocation#by_eu#2#EU_Members#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#Strange-behavior#6#fw4_context2#fw4_context2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#Streaming-Lasttests#2#fw1#fw1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#Streaming-Lasttests#2#router2#router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#Backup#2#fw1#fw1 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#Streaming-Lasttests#2#router1#router1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#US-Drei-WLANCall#2#router1#router1 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#Backup#2#dc_router1#dc_router1 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-Drei-WLANCall#2#fw3_context2#fw3_context2 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#US-Drei-WLANCall#2#fw4_context1#fw4_context1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#US-Drei-WLANCall#2#fw3_context1#fw3_context1 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#Backup#2#fw3_context2#fw3_context2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-Drei-WLANCall#2#fw1#fw1 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#Backup#2#router1#router1 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-IPv6#2#dc_router1#dc_router1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#US-IPv6#2#fw3_context2#fw3_context2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#RDEPLOYMENT#2#dc_router2#dc_router2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-IPv6#2#router2#router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#RDEPLOYMENT#2#fw4_context1#fw4_context1 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-IPv6#2#router1#router1 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#RDEPLOYMENT#2#fw3_context1#fw3_context1 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-IPv6#2#fw1#fw1 for profiler 0

local3.debug: nfsen[13746]: profile opts: network#US-Magenta#6#fromMagenta#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#RDEPLOYMENT#2#fw1#fw1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#RDEPLOYMENT#2#fw2#fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-Mail#2#out#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#ICMP-flood#2#fw4_context2#fw4_context2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#ICMP-flood#2#fw4_context1#fw4_context1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#ICMP-flood#2#fw3_context2#fw3_context2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-Multicast#2#router1#router1 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#ICMP-flood#2#dc_router1#dc_router1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#ICMP-flood#2#dc_router2#dc_router2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-NextLayer#6#toNextLayer#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#MS-Teams#2#router2#router2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-QOS#2#NetworkManagement-TOS64-CS2#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#MS-Teams#2#fw3_context1#fw3_context1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#MS-Teams#2#router1#router1 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-QOS#2#CallSignaling-TOS96-CS3#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#MS-Teams#2#fw1#fw1 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-QOS#2#Video-TOS136-AF41#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#MS-Teams#2#fw2#fw2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#NFS#2#fw4_context2#fw4_context2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-QOS#2#Mission-critical#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#NFS#2#fw3_context2#fw3_context2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-SIL#6#toSil#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#NFS#2#fw4_context1#fw4_context1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#NFS#2#fw3_context1#fw3_context1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#NFS#2#dc_router2#dc_router2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-Telekom#6#toTelekom#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#SAMBA#2#dc_router1#dc_router1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#SAMBA#2#router2#router2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-WiredWireless-Outside#6#ServerIn#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#SAMBA#2#dc_router2#dc_router2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-WiredWireless-Outside#6#WirelessIn#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#SAMBA#2#fw2#fw2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#SAMBA#2#fw1#fw1 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-WiredWireless-Outside#6#WiredOut#router1|router2 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#SQL#2#router2#router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#Strange-behavior#6#dc_router2#dc_router2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-Wireless#2#eduroamWireless#fw3_context2|fw3_context1 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#Strange-behavior#6#fw4_context1#fw4_context1 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-Wireless#2#eduroamWirelessV6#fw3_context2|fw3_context1 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#Strange-behavior#6#dc_router1#dc_router1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#Strange-behavior#6#fw1#fw1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#Strange-behavior#6#fw2#fw2 for profiler 1

local3.debug: nfsen[13746]: profile opts: network#US-Phone-Server#2#router1#router1 for profiler 0

local3.debug: nfsen[13748]: profile opts: network#Streaming-Lasttests#2#fw2#fw2 for profiler 1

local3.debug: nfsen[13746]: profiler 0 started

local3.debug: nfsen[13748]: profile opts: network#Streaming-Lasttests#2#dc_router1#dc_router1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#Streaming-Lasttests#2#dc_router2#dc_router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-Drei-WLANCall#2#dc_router2#dc_router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-Drei-WLANCall#2#router2#router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-Drei-WLANCall#2#dc_router1#dc_router1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-Drei-WLANCall#2#fw4_context2#fw4_context2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-Drei-WLANCall#2#fw2#fw2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-IPv6#2#fw3_context1#fw3_context1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-IPv6#2#fw4_context1#fw4_context1 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-IPv6#2#dc_router2#dc_router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-IPv6#2#fw2#fw2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-IPv6#2#fw4_context2#fw4_context2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-Magenta#6#toMagenta#router1|router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-Mail#2#in#router1|router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-Multicast#2#router2#router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-NextLayer#6#fromNextLayer#router1|router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-QOS#2#DSCP-2#router1|router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-QOS#2#VOIP-TOS184-EF#router1|router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-QOS#2#NetworkControl-TOS192-CS6#router1|router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-QOS#2#MissionCritical-TOS104-AF31#router1|router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-SIL#6#fromSil#router1|router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-Telekom#6#fromTelekom#router1|router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-WiredWireless-Outside#6#ServerOut#router1|router2 for profiler 1

local3.debug: nfsen[13748]: profile opts: network#US-WiredWireless-Outside#6#WirelessOut#router1|router2 for profiler 1

local3.info: nfprofile[13747]: Process line '.#AS#2#amazon#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.debug: nfsen[13748]: profile opts: network#US-WiredWireless-Outside#6#WiredIn#router1|router2 for profiler 1

local3.info: nfprofile[13747]: Process line '.#AS#2#akamai#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Process line '.#AS#2#microsoft#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.debug: nfsen[13748]: profile opts: network#US-Wireless#2#sConnectWired#fw3_context2|fw3_context1 for profiler 1

local3.info: nfprofile[13747]: Process line '.#TorNetworkTraffic#2#src_IP_TOR#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Process line '.#destination_US#2#Source_Internet#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Process line '.#real#2#fw1#fw1'
local3.info: nfprofile[13747]: Process line '.#real#2#fw3_context1#fw3_context1'
local3.info: nfprofile[13747]: Process line '.#real#2#router2#router2'
local3.info: nfprofile[13747]: Process line '.#real#2#router1#router1'
local3.debug: nfsen[13748]: profile opts: network#US-Phone-Server#2#router2#router2 for profiler 1

local3.info: nfprofile[13747]: Process line 'Geolocation#by_continents#2#Asia#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Process line 'Geolocation#by_continents#2#South_America#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Process line 'Geolocation#by_continents#2#North_America#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Process line 'Geolocation#by_country#2#USA#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Process line 'Geolocation#by_country#2#OtherCountries#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Process line 'Geolocation#by_eu#2#None_EU_Members#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Process line 'network#Backup#2#fw2#fw2'
local3.info: nfprofile[13747]: Process line 'network#Backup#2#fw3_context1#fw3_context1'
local3.info: nfprofile[13747]: Process line 'network#Backup#2#router2#router2'
local3.info: nfprofile[13747]: Process line 'network#Backup#2#dc_router2#dc_router2'
local3.info: nfprofile[13747]: Process line 'network#RDEPLOYMENT#2#router1#router1'
local3.info: nfprofile[13747]: Process line 'network#RDEPLOYMENT#2#router2#router2'
local3.info: nfprofile[13747]: Process line 'network#RDEPLOYMENT#2#fw3_context2#fw3_context2'
local3.info: nfprofile[13747]: Process line 'network#RDEPLOYMENT#2#dc_router1#dc_router1'
local3.info: nfprofile[13747]: Process line 'network#RDEPLOYMENT#2#fw4_context2#fw4_context2'
local3.info: nfprofile[13747]: Process line 'network#ICMP-flood#2#fw1#fw1'
local3.info: nfprofile[13747]: Process line 'network#ICMP-flood#2#fw2#fw2'
local3.info: nfprofile[13747]: Process line 'network#ICMP-flood#2#router2#router2'
local3.info: nfprofile[13747]: Process line 'network#ICMP-flood#2#fw3_context1#fw3_context1'
local3.info: nfprofile[13747]: Process line 'network#ICMP-flood#2#router1#router1'
local3.info: nfprofile[13747]: Process line 'network#MS-Teams#2#fw4_context1#fw4_context1'
local3.info: nfprofile[13747]: Process line 'network#MS-Teams#2#fw3_context2#fw3_context2'
local3.info: nfprofile[13747]: Process line 'network#MS-Teams#2#dc_router1#dc_router1'
local3.debug: nfsen[13748]: profiler 1 started

local3.info: nfprofile[13747]: Process line 'network#MS-Teams#2#dc_router2#dc_router2'
local3.info: nfprofile[13747]: Process line 'network#MS-Teams#2#fw4_context2#fw4_context2'
local3.info: nfprofile[13747]: Process line 'network#NFS#2#fw1#fw1'
local3.info: nfprofile[13747]: Process line 'network#NFS#2#fw2#fw2'
local3.info: nfprofile[13747]: Process line 'network#NFS#2#router2#router2'
local3.info: nfprofile[13747]: Process line 'network#NFS#2#dc_router1#dc_router1'
local3.info: nfprofile[13747]: Process line 'network#NFS#2#router1#router1'
local3.info: nfprofile[13747]: Process line 'network#SAMBA#2#fw3_context1#fw3_context1'
local3.info: nfprofile[13747]: Process line 'network#SAMBA#2#fw4_context1#fw4_context1'
local3.info: nfprofile[13747]: Process line 'network#SAMBA#2#fw3_context2#fw3_context2'
local3.info: nfprofile[13747]: Process line 'network#SAMBA#2#router1#router1'
local3.info: nfprofile[13747]: Process line 'network#SAMBA#2#fw4_context2#fw4_context2'
local3.info: nfprofile[13747]: Process line 'network#SQL#2#router1#router1'
local3.info: nfprofile[13747]: Process line 'network#Strange-behavior#6#router1#router1'
local3.info: nfprofile[13747]: Process line 'network#Strange-behavior#6#fw3_context2#fw3_context2'
local3.info: nfprofile[13747]: Process line 'network#Strange-behavior#6#router2#router2'
local3.info: nfprofile[13747]: Process line 'network#Strange-behavior#6#fw3_context1#fw3_context1'
local3.info: nfprofile[13747]: Process line 'network#Strange-behavior#6#fw4_context2#fw4_context2'
local3.info: nfprofile[13747]: Process line 'network#Streaming-Lasttests#2#fw1#fw1'
local3.info: nfprofile[13747]: Process line 'network#Streaming-Lasttests#2#router2#router2'
local3.info: nfprofile[13747]: Process line 'network#Streaming-Lasttests#2#router1#router1'
local3.info: nfprofile[13747]: Process line 'network#US-Drei-WLANCall#2#router1#router1'
local3.info: nfprofile[13747]: Process line 'network#US-Drei-WLANCall#2#fw3_context2#fw3_context2'
local3.info: nfprofile[13747]: Process line 'network#US-Drei-WLANCall#2#fw4_context1#fw4_context1'
local3.info: nfprofile[13747]: Process line 'network#US-Drei-WLANCall#2#fw3_context1#fw3_context1'
local3.info: nfprofile[13747]: Process line 'network#US-Drei-WLANCall#2#fw1#fw1'
local3.info: nfprofile[13747]: Process line 'network#US-IPv6#2#dc_router1#dc_router1'
local3.info: nfprofile[13747]: Process line 'network#US-IPv6#2#fw3_context2#fw3_context2'
local3.info: nfprofile[13747]: Process line 'network#US-IPv6#2#router2#router2'
local3.info: nfprofile[13747]: Process line 'network#US-IPv6#2#router1#router1'
local3.info: nfprofile[13747]: Process line 'network#US-IPv6#2#fw1#fw1'
local3.info: nfprofile[13747]: Process line 'network#US-Magenta#6#fromMagenta#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-Mail#2#out#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-Multicast#2#router1#router1'
local3.info: nfprofile[13747]: Process line 'network#US-NextLayer#6#toNextLayer#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-QOS#2#NetworkManagement-TOS64-CS2#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-QOS#2#CallSignaling-TOS96-CS3#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-QOS#2#Video-TOS136-AF41#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-QOS#2#Mission-critical#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-SIL#6#toSil#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-Telekom#6#toTelekom#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-WiredWireless-Outside#6#ServerIn#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-WiredWireless-Outside#6#WirelessIn#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-WiredWireless-Outside#6#WiredOut#router1|router2'
local3.info: nfprofile[13747]: Process line 'network#US-Wireless#2#eduroamWireless#fw3_context2|fw3_context1'
local3.info: nfprofile[13747]: Process line 'network#US-Wireless#2#eduroamWirelessV6#fw3_context2|fw3_context1'
local3.info: nfprofile[13747]: Process line 'network#US-Phone-Server#2#router1#router1'
local3.info: nfprofile[13749]: Process line '.#AS#2#US#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line '.#AS#2#google#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line '.#AS#2#netflix#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line '.#AS#2#aconet#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line '.#TorNetworkTraffic#2#dst_IP_TOR#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line '.#real#2#fw2#fw2'
local3.info: nfprofile[13749]: Process line '.#real#2#dc_router1#dc_router1'
local3.info: nfprofile[13749]: Process line '.#real#2#fw3_context2#fw3_context2'
local3.info: nfprofile[13749]: Process line '.#real#2#dc_router2#dc_router2'
local3.info: nfprofile[13749]: Process line 'Geolocation#by_continents#2#Antarctica#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line 'Geolocation#by_continents#2#Africa#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line 'Geolocation#by_continents#2#Oceania#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line 'Geolocation#by_continents#2#Europe#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line 'Geolocation#by_country#2#Austria#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line 'Geolocation#by_country#2#Germany#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line 'Geolocation#by_eu#2#EU_Members#dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Process line 'network#Backup#2#fw1#fw1'
local3.info: nfprofile[13749]: Process line 'network#Backup#2#dc_router1#dc_router1'
local3.info: nfprofile[13749]: Process line 'network#Backup#2#fw3_context2#fw3_context2'
local3.info: nfprofile[13749]: Process line 'network#Backup#2#router1#router1'
local3.info: nfprofile[13749]: Process line 'network#RDEPLOYMENT#2#dc_router2#dc_router2'
local3.info: nfprofile[13749]: Process line 'network#RDEPLOYMENT#2#fw4_context1#fw4_context1'
local3.info: nfprofile[13749]: Process line 'network#RDEPLOYMENT#2#fw3_context1#fw3_context1'
local3.info: nfprofile[13749]: Process line 'network#RDEPLOYMENT#2#fw1#fw1'
local3.info: nfprofile[13749]: Process line 'network#RDEPLOYMENT#2#fw2#fw2'
local3.info: nfprofile[13749]: Process line 'network#ICMP-flood#2#fw4_context2#fw4_context2'
local3.info: nfprofile[13749]: Process line 'network#ICMP-flood#2#fw4_context1#fw4_context1'
local3.info: nfprofile[13749]: Process line 'network#ICMP-flood#2#fw3_context2#fw3_context2'
local3.info: nfprofile[13749]: Process line 'network#ICMP-flood#2#dc_router1#dc_router1'
local3.info: nfprofile[13749]: Process line 'network#ICMP-flood#2#dc_router2#dc_router2'
local3.info: nfprofile[13749]: Process line 'network#MS-Teams#2#router2#router2'
local3.info: nfprofile[13749]: Process line 'network#MS-Teams#2#fw3_context1#fw3_context1'
local3.info: nfprofile[13749]: Process line 'network#MS-Teams#2#router1#router1'
local3.info: nfprofile[13749]: Process line 'network#MS-Teams#2#fw1#fw1'
local3.info: nfprofile[13749]: Process line 'network#MS-Teams#2#fw2#fw2'
local3.info: nfprofile[13749]: Process line 'network#NFS#2#fw4_context2#fw4_context2'
local3.info: nfprofile[13749]: Process line 'network#NFS#2#fw3_context2#fw3_context2'
local3.info: nfprofile[13749]: Process line 'network#NFS#2#fw4_context1#fw4_context1'
local3.info: nfprofile[13749]: Process line 'network#NFS#2#fw3_context1#fw3_context1'
local3.info: nfprofile[13749]: Process line 'network#NFS#2#dc_router2#dc_router2'
local3.info: nfprofile[13749]: Process line 'network#SAMBA#2#dc_router1#dc_router1'
local3.info: nfprofile[13749]: Process line 'network#SAMBA#2#router2#router2'
local3.info: nfprofile[13749]: Process line 'network#SAMBA#2#dc_router2#dc_router2'
local3.info: nfprofile[13749]: Process line 'network#SAMBA#2#fw2#fw2'
local3.info: nfprofile[13749]: Process line 'network#SAMBA#2#fw1#fw1'
local3.info: nfprofile[13749]: Process line 'network#SQL#2#router2#router2'
local3.info: nfprofile[13749]: Process line 'network#Strange-behavior#6#dc_router2#dc_router2'
local3.info: nfprofile[13749]: Process line 'network#Strange-behavior#6#fw4_context1#fw4_context1'
local3.info: nfprofile[13749]: Process line 'network#Strange-behavior#6#dc_router1#dc_router1'
local3.info: nfprofile[13749]: Process line 'network#Strange-behavior#6#fw1#fw1'
local3.info: nfprofile[13749]: Process line 'network#Strange-behavior#6#fw2#fw2'
local3.info: nfprofile[13749]: Process line 'network#Streaming-Lasttests#2#fw2#fw2'
local3.info: nfprofile[13749]: Process line 'network#Streaming-Lasttests#2#dc_router1#dc_router1'
local3.info: nfprofile[13749]: Process line 'network#Streaming-Lasttests#2#dc_router2#dc_router2'
local3.info: nfprofile[13749]: Process line 'network#US-Drei-WLANCall#2#dc_router2#dc_router2'
local3.info: nfprofile[13749]: Process line 'network#US-Drei-WLANCall#2#router2#router2'
local3.info: nfprofile[13749]: Process line 'network#US-Drei-WLANCall#2#dc_router1#dc_router1'
local3.info: nfprofile[13749]: Process line 'network#US-Drei-WLANCall#2#fw4_context2#fw4_context2'
local3.info: nfprofile[13749]: Process line 'network#US-Drei-WLANCall#2#fw2#fw2'
local3.info: nfprofile[13749]: Process line 'network#US-IPv6#2#fw3_context1#fw3_context1'
local3.info: nfprofile[13749]: Process line 'network#US-IPv6#2#fw4_context1#fw4_context1'
local3.info: nfprofile[13749]: Process line 'network#US-IPv6#2#dc_router2#dc_router2'
local3.info: nfprofile[13749]: Process line 'network#US-IPv6#2#fw2#fw2'
local3.info: nfprofile[13749]: Process line 'network#US-IPv6#2#fw4_context2#fw4_context2'
local3.info: nfprofile[13749]: Process line 'network#US-Magenta#6#toMagenta#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-Mail#2#in#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-Multicast#2#router2#router2'
local3.info: nfprofile[13749]: Process line 'network#US-NextLayer#6#fromNextLayer#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-QOS#2#DSCP-2#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-QOS#2#VOIP-TOS184-EF#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-QOS#2#NetworkControl-TOS192-CS6#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-QOS#2#MissionCritical-TOS104-AF31#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-SIL#6#fromSil#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-Telekom#6#fromTelekom#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-WiredWireless-Outside#6#ServerOut#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-WiredWireless-Outside#6#WirelessOut#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-WiredWireless-Outside#6#WiredIn#router1|router2'
local3.info: nfprofile[13749]: Process line 'network#US-Wireless#2#sConnectWired#fw3_context2|fw3_context1'
local3.info: nfprofile[13749]: Process line 'network#US-Phone-Server#2#router2#router2'
local3.info: nfprofile[13749]: Setup channel 'US' in profile 'AS' group '.', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.error: nfprofile[13749]: stat() error '/data/nfsen/profiles-data/live/fw5_context1/nfcapd.202409041100': File not found!
local3.info: nfprofile[13749]: Setup channel 'google' in profile 'AS' group '.', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'netflix' in profile 'AS' group '.', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'aconet' in profile 'AS' group '.', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'dst_IP_TOR' in profile 'TorNetworkTraffic' group '.', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'fw2' in profile 'real' group '.', channellist 'fw2'
local3.info: nfprofile[13749]: Setup channel 'dc_router1' in profile 'real' group '.', channellist 'dc_router1'
local3.info: nfprofile[13749]: Setup channel 'fw3_context2' in profile 'real' group '.', channellist 'fw3_context2'
local3.info: nfprofile[13749]: Setup channel 'dc_router2' in profile 'real' group '.', channellist 'dc_router2'
local3.info: nfprofile[13749]: Setup channel 'Antarctica' in profile 'by_continents' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'Africa' in profile 'by_continents' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'Oceania' in profile 'by_continents' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'Europe' in profile 'by_continents' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'Austria' in profile 'by_country' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'Germany' in profile 'by_country' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'EU_Members' in profile 'by_eu' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13749]: Setup channel 'fw1' in profile 'Backup' group 'network', channellist 'fw1'
local3.info: nfprofile[13749]: Setup channel 'dc_router1' in profile 'Backup' group 'network', channellist 'dc_router1'
local3.info: nfprofile[13749]: Setup channel 'fw3_context2' in profile 'Backup' group 'network', channellist 'fw3_context2'
local3.info: nfprofile[13749]: Setup channel 'router1' in profile 'Backup' group 'network', channellist 'router1'
local3.info: nfprofile[13749]: Setup channel 'dc_router2' in profile 'RDEPLOYMENT' group 'network', channellist 'dc_router2'
local3.info: nfprofile[13749]: Setup channel 'fw4_context1' in profile 'RDEPLOYMENT' group 'network', channellist 'fw4_context1'
local3.info: nfprofile[13749]: Setup channel 'fw3_context1' in profile 'RDEPLOYMENT' group 'network', channellist 'fw3_context1'
local3.info: nfprofile[13749]: Setup channel 'fw1' in profile 'RDEPLOYMENT' group 'network', channellist 'fw1'
local3.info: nfprofile[13749]: Setup channel 'fw2' in profile 'RDEPLOYMENT' group 'network', channellist 'fw2'
local3.info: nfprofile[13749]: Setup channel 'fw4_context2' in profile 'ICMP-flood' group 'network', channellist 'fw4_context2'
local3.info: nfprofile[13749]: Setup channel 'fw4_context1' in profile 'ICMP-flood' group 'network', channellist 'fw4_context1'
local3.info: nfprofile[13749]: Setup channel 'fw3_context2' in profile 'ICMP-flood' group 'network', channellist 'fw3_context2'
local3.info: nfprofile[13749]: Setup channel 'dc_router1' in profile 'ICMP-flood' group 'network', channellist 'dc_router1'
local3.info: nfprofile[13749]: Setup channel 'dc_router2' in profile 'ICMP-flood' group 'network', channellist 'dc_router2'
local3.info: nfprofile[13749]: Setup channel 'router2' in profile 'MS-Teams' group 'network', channellist 'router2'
local3.info: nfprofile[13749]: Setup channel 'fw3_context1' in profile 'MS-Teams' group 'network', channellist 'fw3_context1'
local3.info: nfprofile[13749]: Setup channel 'router1' in profile 'MS-Teams' group 'network', channellist 'router1'
local3.info: nfprofile[13749]: Setup channel 'fw1' in profile 'MS-Teams' group 'network', channellist 'fw1'
local3.info: nfprofile[13749]: Setup channel 'fw2' in profile 'MS-Teams' group 'network', channellist 'fw2'
local3.info: nfprofile[13749]: Setup channel 'fw4_context2' in profile 'NFS' group 'network', channellist 'fw4_context2'
local3.info: nfprofile[13749]: Setup channel 'fw3_context2' in profile 'NFS' group 'network', channellist 'fw3_context2'
local3.info: nfprofile[13749]: Setup channel 'fw4_context1' in profile 'NFS' group 'network', channellist 'fw4_context1'
local3.info: nfprofile[13749]: Setup channel 'fw3_context1' in profile 'NFS' group 'network', channellist 'fw3_context1'
local3.info: nfprofile[13749]: Setup channel 'dc_router2' in profile 'NFS' group 'network', channellist 'dc_router2'
local3.info: nfprofile[13749]: Setup channel 'dc_router1' in profile 'SAMBA' group 'network', channellist 'dc_router1'
local3.info: nfprofile[13749]: Setup channel 'router2' in profile 'SAMBA' group 'network', channellist 'router2'
local3.info: nfprofile[13749]: Setup channel 'dc_router2' in profile 'SAMBA' group 'network', channellist 'dc_router2'
local3.info: nfprofile[13749]: Setup channel 'fw2' in profile 'SAMBA' group 'network', channellist 'fw2'
local3.info: nfprofile[13749]: Setup channel 'fw1' in profile 'SAMBA' group 'network', channellist 'fw1'
local3.info: nfprofile[13749]: Setup channel 'router2' in profile 'SQL' group 'network', channellist 'router2'
local3.info: nfprofile[13749]: Setup channel 'dc_router2' in profile 'Strange-behavior' group 'network', channellist 'dc_router2'
local3.info: nfprofile[13749]: Setup channel 'fw4_context1' in profile 'Strange-behavior' group 'network', channellist 'fw4_context1'
local3.info: nfprofile[13749]: Setup channel 'dc_router1' in profile 'Strange-behavior' group 'network', channellist 'dc_router1'
local3.info: nfprofile[13749]: Setup channel 'fw1' in profile 'Strange-behavior' group 'network', channellist 'fw1'
local3.info: nfprofile[13749]: Setup channel 'fw2' in profile 'Strange-behavior' group 'network', channellist 'fw2'
local3.info: nfprofile[13749]: Setup channel 'fw2' in profile 'Streaming-Lasttests' group 'network', channellist 'fw2'
local3.info: nfprofile[13749]: Setup channel 'dc_router1' in profile 'Streaming-Lasttests' group 'network', channellist 'dc_router1'
local3.info: nfprofile[13749]: Setup channel 'dc_router2' in profile 'Streaming-Lasttests' group 'network', channellist 'dc_router2'
local3.info: nfprofile[13749]: Setup channel 'dc_router2' in profile 'US-Drei-WLANCall' group 'network', channellist 'dc_router2'
local3.info: nfprofile[13749]: Setup channel 'router2' in profile 'US-Drei-WLANCall' group 'network', channellist 'router2'
local3.info: nfprofile[13749]: Setup channel 'dc_router1' in profile 'US-Drei-WLANCall' group 'network', channellist 'dc_router1'
local3.info: nfprofile[13749]: Setup channel 'fw4_context2' in profile 'US-Drei-WLANCall' group 'network', channellist 'fw4_context2'
local3.info: nfprofile[13749]: Setup channel 'fw2' in profile 'US-Drei-WLANCall' group 'network', channellist 'fw2'
local3.info: nfprofile[13749]: Setup channel 'fw3_context1' in profile 'US-IPv6' group 'network', channellist 'fw3_context1'
local3.info: nfprofile[13749]: Setup channel 'fw4_context1' in profile 'US-IPv6' group 'network', channellist 'fw4_context1'
local3.info: nfprofile[13749]: Setup channel 'dc_router2' in profile 'US-IPv6' group 'network', channellist 'dc_router2'
local3.info: nfprofile[13749]: Setup channel 'fw2' in profile 'US-IPv6' group 'network', channellist 'fw2'
local3.info: nfprofile[13749]: Setup channel 'fw4_context2' in profile 'US-IPv6' group 'network', channellist 'fw4_context2'
local3.info: nfprofile[13749]: Setup channel 'toMagenta' in profile 'US-Magenta' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13749]: Setup channel 'in' in profile 'US-Mail' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13749]: Setup channel 'router2' in profile 'US-Multicast' group 'network', channellist 'router2'
local3.info: nfprofile[13747]: Setup channel 'amazon' in profile 'AS' group '.', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.error: nfprofile[13747]: stat() error '/data/nfsen/profiles-data/live/fw5_context1/nfcapd.202409041100': File not found!
local3.info: nfprofile[13747]: Setup channel 'akamai' in profile 'AS' group '.', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Setup channel 'microsoft' in profile 'AS' group '.', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Setup channel 'src_IP_TOR' in profile 'TorNetworkTraffic' group '.', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Setup channel 'Source_Internet' in profile 'destination_US' group '.', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Setup channel 'fw1' in profile 'real' group '.', channellist 'fw1'
local3.info: nfprofile[13747]: Setup channel 'fw3_context1' in profile 'real' group '.', channellist 'fw3_context1'
local3.info: nfprofile[13747]: Setup channel 'router2' in profile 'real' group '.', channellist 'router2'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'real' group '.', channellist 'router1'
local3.info: nfprofile[13747]: Setup channel 'Asia' in profile 'by_continents' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Setup channel 'South_America' in profile 'by_continents' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Setup channel 'North_America' in profile 'by_continents' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Setup channel 'USA' in profile 'by_country' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Setup channel 'OtherCountries' in profile 'by_country' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Setup channel 'None_EU_Members' in profile 'by_eu' group 'Geolocation', channellist 'dc_router1|fw1|router1|router2|dc_router2|fw4_context1|fw4_context2|fw3_context2|fw3_context1|fw2'
local3.info: nfprofile[13747]: Setup channel 'fw2' in profile 'Backup' group 'network', channellist 'fw2'
local3.info: nfprofile[13747]: Setup channel 'fw3_context1' in profile 'Backup' group 'network', channellist 'fw3_context1'
local3.info: nfprofile[13747]: Setup channel 'router2' in profile 'Backup' group 'network', channellist 'router2'
local3.info: nfprofile[13747]: Setup channel 'dc_router2' in profile 'Backup' group 'network', channellist 'dc_router2'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'RDEPLOYMENT' group 'network', channellist 'router1'
local3.info: nfprofile[13747]: Setup channel 'router2' in profile 'RDEPLOYMENT' group 'network', channellist 'router2'
local3.info: nfprofile[13747]: Setup channel 'fw3_context2' in profile 'RDEPLOYMENT' group 'network', channellist 'fw3_context2'
local3.info: nfprofile[13747]: Setup channel 'dc_router1' in profile 'RDEPLOYMENT' group 'network', channellist 'dc_router1'
local3.info: nfprofile[13747]: Setup channel 'fw4_context2' in profile 'RDEPLOYMENT' group 'network', channellist 'fw4_context2'
local3.info: nfprofile[13747]: Setup channel 'fw1' in profile 'ICMP-flood' group 'network', channellist 'fw1'
local3.info: nfprofile[13747]: Setup channel 'fw2' in profile 'ICMP-flood' group 'network', channellist 'fw2'
local3.info: nfprofile[13747]: Setup channel 'router2' in profile 'ICMP-flood' group 'network', channellist 'router2'
local3.info: nfprofile[13747]: Setup channel 'fw3_context1' in profile 'ICMP-flood' group 'network', channellist 'fw3_context1'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'ICMP-flood' group 'network', channellist 'router1'
local3.info: nfprofile[13747]: Setup channel 'fw4_context1' in profile 'MS-Teams' group 'network', channellist 'fw4_context1'
local3.info: nfprofile[13747]: Setup channel 'fw3_context2' in profile 'MS-Teams' group 'network', channellist 'fw3_context2'
local3.info: nfprofile[13747]: Setup channel 'dc_router1' in profile 'MS-Teams' group 'network', channellist 'dc_router1'
local3.info: nfprofile[13747]: Setup channel 'dc_router2' in profile 'MS-Teams' group 'network', channellist 'dc_router2'
local3.info: nfprofile[13747]: Setup channel 'fw4_context2' in profile 'MS-Teams' group 'network', channellist 'fw4_context2'
local3.info: nfprofile[13747]: Setup channel 'fw1' in profile 'NFS' group 'network', channellist 'fw1'
local3.info: nfprofile[13747]: Setup channel 'fw2' in profile 'NFS' group 'network', channellist 'fw2'
local3.info: nfprofile[13747]: Setup channel 'router2' in profile 'NFS' group 'network', channellist 'router2'
local3.info: nfprofile[13747]: Setup channel 'dc_router1' in profile 'NFS' group 'network', channellist 'dc_router1'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'NFS' group 'network', channellist 'router1'
local3.info: nfprofile[13747]: Setup channel 'fw3_context1' in profile 'SAMBA' group 'network', channellist 'fw3_context1'
local3.info: nfprofile[13747]: Setup channel 'fw4_context1' in profile 'SAMBA' group 'network', channellist 'fw4_context1'
local3.info: nfprofile[13747]: Setup channel 'fw3_context2' in profile 'SAMBA' group 'network', channellist 'fw3_context2'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'SAMBA' group 'network', channellist 'router1'
local3.info: nfprofile[13747]: Setup channel 'fw4_context2' in profile 'SAMBA' group 'network', channellist 'fw4_context2'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'SQL' group 'network', channellist 'router1'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'Strange-behavior' group 'network', channellist 'router1'
local3.info: nfprofile[13747]: Setup channel 'fw3_context2' in profile 'Strange-behavior' group 'network', channellist 'fw3_context2'
local3.info: nfprofile[13747]: Setup channel 'router2' in profile 'Strange-behavior' group 'network', channellist 'router2'
local3.info: nfprofile[13747]: Setup channel 'fw3_context1' in profile 'Strange-behavior' group 'network', channellist 'fw3_context1'
local3.info: nfprofile[13747]: Setup channel 'fw4_context2' in profile 'Strange-behavior' group 'network', channellist 'fw4_context2'
local3.info: nfprofile[13747]: Setup channel 'fw1' in profile 'Streaming-Lasttests' group 'network', channellist 'fw1'
local3.info: nfprofile[13747]: Setup channel 'router2' in profile 'Streaming-Lasttests' group 'network', channellist 'router2'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'Streaming-Lasttests' group 'network', channellist 'router1'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'US-Drei-WLANCall' group 'network', channellist 'router1'
local3.info: nfprofile[13747]: Setup channel 'fw3_context2' in profile 'US-Drei-WLANCall' group 'network', channellist 'fw3_context2'
local3.info: nfprofile[13747]: Setup channel 'fw4_context1' in profile 'US-Drei-WLANCall' group 'network', channellist 'fw4_context1'
local3.info: nfprofile[13747]: Setup channel 'fw3_context1' in profile 'US-Drei-WLANCall' group 'network', channellist 'fw3_context1'
local3.info: nfprofile[13749]: Setup channel 'fromNextLayer' in profile 'US-NextLayer' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13749]: Setup channel 'DSCP-2' in profile 'US-QOS' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'fw1' in profile 'US-Drei-WLANCall' group 'network', channellist 'fw1'
local3.info: nfprofile[13749]: Setup channel 'VOIP-TOS184-EF' in profile 'US-QOS' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'dc_router1' in profile 'US-IPv6' group 'network', channellist 'dc_router1'
local3.info: nfprofile[13749]: Setup channel 'NetworkControl-TOS192-CS6' in profile 'US-QOS' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'fw3_context2' in profile 'US-IPv6' group 'network', channellist 'fw3_context2'
local3.info: nfprofile[13749]: Setup channel 'MissionCritical-TOS104-AF31' in profile 'US-QOS' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'router2' in profile 'US-IPv6' group 'network', channellist 'router2'
local3.info: nfprofile[13749]: Setup channel 'fromSil' in profile 'US-SIL' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13749]: Setup channel 'fromTelekom' in profile 'US-Telekom' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13749]: Setup channel 'ServerOut' in profile 'US-WiredWireless-Outside' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13749]: Setup channel 'WirelessOut' in profile 'US-WiredWireless-Outside' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13749]: Setup channel 'WiredIn' in profile 'US-WiredWireless-Outside' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'US-IPv6' group 'network', channellist 'router1'
local3.info: nfprofile[13749]: Setup channel 'sConnectWired' in profile 'US-Wireless' group 'network', channellist 'fw3_context2|fw3_context1'
local3.info: nfprofile[13749]: Setup channel 'router2' in profile 'US-Phone-Server' group 'network', channellist 'router2'
local3.info: nfprofile[13747]: Setup channel 'fw1' in profile 'US-IPv6' group 'network', channellist 'fw1'
local3.info: nfprofile[13747]: Setup channel 'fromMagenta' in profile 'US-Magenta' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'out' in profile 'US-Mail' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'US-Multicast' group 'network', channellist 'router1'
local3.info: nfprofile[13747]: Setup channel 'toNextLayer' in profile 'US-NextLayer' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'NetworkManagement-TOS64-CS2' in profile 'US-QOS' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'CallSignaling-TOS96-CS3' in profile 'US-QOS' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'Video-TOS136-AF41' in profile 'US-QOS' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'Mission-critical' in profile 'US-QOS' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'toSil' in profile 'US-SIL' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'toTelekom' in profile 'US-Telekom' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'ServerIn' in profile 'US-WiredWireless-Outside' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'WirelessIn' in profile 'US-WiredWireless-Outside' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'WiredOut' in profile 'US-WiredWireless-Outside' group 'network', channellist 'router1|router2'
local3.info: nfprofile[13747]: Setup channel 'eduroamWireless' in profile 'US-Wireless' group 'network', channellist 'fw3_context2|fw3_context1'
local3.info: nfprofile[13747]: Setup channel 'eduroamWirelessV6' in profile 'US-Wireless' group 'network', channellist 'fw3_context2|fw3_context1'
local3.info: nfprofile[13747]: Setup channel 'router1' in profile 'US-Phone-Server' group 'network', channellist 'router1'
local3.debug: nfsen[13746]: profiler 0 finished

local3.debug: nfsen[13748]: profiler 1 finished

local3.info: nfsen[493]: Update profile AS in group .

local3.debug: nfsen[493]: Add .:AS:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile TorNetworkTraffic in group .

local3.debug: nfsen[493]: Add .:TorNetworkTraffic:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile destination_US in group .

local3.debug: nfsen[493]: Add .:destination_US:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile live in group .

local3.error: nfsen[493]: Run nfdump failed: Exit: 1, Signal: 0, Coredump: 0

local3.debug: nfsen[493]: Add .:live:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile real in group .

local3.debug: nfsen[493]: Add .:real:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile by_continents in group Geolocation

local3.debug: nfsen[493]: Add Geolocation:by_continents:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile by_country in group Geolocation

local3.debug: nfsen[493]: Add Geolocation:by_country:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile by_eu in group Geolocation

local3.debug: nfsen[493]: Add Geolocation:by_eu:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile Backup in group network

local3.debug: nfsen[493]: Add network:Backup:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile RDEPLOYMENT in group network

local3.debug: nfsen[493]: Add network:RDEPLOYMENT:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile ICMP-flood in group network

local3.debug: nfsen[493]: Add network:ICMP-flood:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile MS-Teams in group network

local3.debug: nfsen[493]: Add network:MS-Teams:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile NFS in group network

local3.debug: nfsen[493]: Add network:NFS:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile SAMBA in group network

local3.debug: nfsen[493]: Add network:SAMBA:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile SQL in group network

local3.debug: nfsen[493]: Add network:SQL:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile Strange-behavior in group network

local3.info: nfsen[493]: Update profile Streaming-Lasttests in group network

local3.debug: nfsen[493]: Add network:Streaming-Lasttests:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile US-Drei-WLANCall in group network

local3.debug: nfsen[493]: Add network:US-Drei-WLANCall:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile US-IPv6 in group network

local3.debug: nfsen[493]: Add network:US-IPv6:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile US-Magenta in group network

local3.info: nfsen[493]: Update profile US-Mail in group network

local3.debug: nfsen[493]: Add network:US-Mail:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile US-Multicast in group network

local3.debug: nfsen[493]: Add network:US-Multicast:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile US-NextLayer in group network

local3.info: nfsen[493]: Update profile US-QOS in group network

local3.debug: nfsen[493]: Add network:US-QOS:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile US-SIL in group network

local3.info: nfsen[493]: Update profile US-Telekom in group network

local3.info: nfsen[493]: Update profile US-WiredWireless-Outside in group network

local3.info: nfsen[493]: Update profile US-Wireless in group network

local3.debug: nfsen[493]: Add network:US-Wireless:202409041100 for plugin processing

local3.info: nfsen[493]: Update profile US-Phone-Server in group network

local3.debug: nfsen[493]: Add network:US-Phone-Server:202409041100 for plugin processing

local3.debug: nfsen[14498]: expire child

local3.debug: nfsen[493]: Expire forked

local3.debug: nfsen[493]: Run plugins for 202409041100

local3.info: nfsen[14498]: Run expire at Wed Sep  4 11:05:00 2024

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 14499

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile AS group . low water mark: 90% 

local3.debug: nfsen[14499]: Cmd Decode: run-plugins

local3.debug: nfsen[14499]: Plugin Cycle: ., AS, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: AS, Group: ., Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: ., Profile: AS, Time: 202409041100

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile TorNetworkTraffic group . low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile destination_US group . low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile live group . low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/dc_router1

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/fw5_context1

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/fw5_context2

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/fw1

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/router1

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/router2

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/dc_router2

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/fw4_context1

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/fw4_context2

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/fw3_context2

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/fw3_context1

local3.debug: nfsen[14498]: nfexpire: Include nfcapd bookkeeping record in /data/nfsen/profiles-data/live/fw2

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile real group . low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile by_continents group Geolocation low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile by_country group Geolocation low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile by_eu group Geolocation low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile Backup group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile RDEPLOYMENT group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile ICMP-flood group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile MS-Teams group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile NFS group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile SAMBA group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile SQL group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile Streaming-Lasttests group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile US-Drei-WLANCall group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile US-IPv6 group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile US-Mail group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile US-Multicast group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile US-QOS group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile US-Wireless group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: Expire has 220s in this slot!

local3.info: nfsen[14498]: Expire profile US-Phone-Server group network low water mark: 90% 

local3.debug: nfsen[14498]: nfexpire: Expired files:      0

local3.debug: nfsen[14498]: nfexpire: Expired file size:  0 B

local3.debug: nfsen[14498]: nfexpire: Expired time range: 0 sec

local3.debug: nfsen[14498]: nfexpire: 

local3.info: nfsen[14498]: End expire at Wed Sep  4 11:05:00 2024

local3.debug: nfsen[14498]: expire child done

local3.debug: nfsen[14499]: Plugin Cycle: ., TorNetworkTraffic, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: TorNetworkTraffic, Group: ., Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: ., Profile: TorNetworkTraffic, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: ., destination_US, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: destination_US, Group: ., Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: ., Profile: destination_US, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: ., live, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: live, Group: ., Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: ., Profile: live, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: ., real, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: real, Group: ., Module: PortTracker, 

local3.debug: nfsen[14499]: PortTracker run: Profile: real, Time: 202409041100

local3.debug: nfsen[14499]: /usr/local/bin/nftrack -L local3 -M /data/nfsen/profiles-data/real/fw1:router1:dc_router2:fw2:fw3_context2:router2:dc_router1:fw3_context1 -r nfcapd.202409041100 -d /data/nfsen/db/ports -A -t 202409041100 -s -p -w /data/nfsen/db/ports/portstat.txt

local3.debug: nfsen[14499]: nftrack exited with value 0

local3.debug: nfsen[14499]: /usr/local/bin/nftrack -d /data/nfsen/db/ports -S -p -w /data/nfsen/db/ports/portstat24.txt

local3.debug: nfsen[14499]: nftrack exited with value 0

local3.debug: nfsen[14499]: PortTracker run: Done.

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: real, Group: ., Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: ., Profile: real, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: Geolocation, by_continents, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: by_continents, Group: Geolocation, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: Geolocation, Profile: by_continents, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: Geolocation, by_country, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: by_country, Group: Geolocation, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: Geolocation, Profile: by_country, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: Geolocation, by_eu, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: by_eu, Group: Geolocation, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: Geolocation, Profile: by_eu, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, Backup, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: Backup, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: Backup, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, RDEPLOYMENT, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: RDEPLOYMENT, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: RDEPLOYMENT, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, ICMP-flood, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: ICMP-flood, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: ICMP-flood, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, MS-Teams, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: MS-Teams, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: MS-Teams, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, NFS, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: NFS, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: NFS, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, SAMBA, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: SAMBA, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: SAMBA, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, SQL, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: SQL, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: SQL, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, Streaming-Lasttests, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: Streaming-Lasttests, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: Streaming-Lasttests, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, US-Drei-WLANCall, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: US-Drei-WLANCall, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: US-Drei-WLANCall, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, US-IPv6, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: US-IPv6, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: US-IPv6, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, US-Mail, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: US-Mail, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: US-Mail, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, US-Multicast, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: US-Multicast, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: US-Multicast, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, US-QOS, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: US-QOS, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: US-QOS, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, US-Wireless, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: US-Wireless, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: US-Wireless, Time: 202409041100

local3.debug: nfsen[14499]: Plugin Cycle: network, US-Phone-Server, 202409041100

local3.info: nfsen[14499]: Plugin Cycle: Time: 202409041100, Profile: US-Phone-Server, Group: network, Module: flowdoh, 

local3.debug: nfsen[14499]: flowdoh run: Profilegroup: network, Profile: US-Phone-Server, Time: 202409041100

local3.debug: nfsen[14499]: Cmd Decode: quit

local3.debug: nfsen[493]: Run plugins done.

local3.debug: nfsen[493]: Check alerts for Wed Sep  4 11:00:00 2024

local3.debug: nfsen[493]: Check alerts done.

local3.debug: nfsen[493]: wait for expire child

local3.debug: nfsen[493]: Expire child terminated

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 17288

local3.debug: nfsen[17288]: Cmd Decode: signal

local3.debug: nfsen[17288]: Cmd Decode: quit

local3.debug: nfsen[17288]: Cleanup Routine

local3.debug: nfsen[493]: Signal 'end-periodic'

local3.debug: nfsen[494]: comm child[14499] terminated with no exit value

local3.debug: nfsen[494]: comm child[17288] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20121

local3.debug: nfsen[20121]: Cmd Decode: get-globals

local3.debug: nfsen[20121]: Cmd Decode: get-du

local3.debug: nfsen[20121]: comm child[20122] terminated with no exit value

local3.debug: nfsen[20121]: Cmd Decode: get-profile

local3.debug: nfsen[20121]: Cmd Decode: quit

local3.debug: nfsen[494]: comm child[20121] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20123

local3.debug: nfsen[20123]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20123] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20130

local3.debug: nfsen[20130]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20130] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20131

local3.debug: nfsen[20131]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20131] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20132

local3.debug: nfsen[20132]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20132] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20133

local3.debug: nfsen[20133]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20133] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20137

local3.debug: nfsen[20137]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20137] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20138

local3.debug: nfsen[20138]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20138] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20139

local3.debug: nfsen[20139]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20139] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20140

local3.debug: nfsen[20140]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20140] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20141

local3.debug: nfsen[20141]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20141] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20142

local3.debug: nfsen[20142]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20142] terminated with no exit value

local3.debug: nfsen[494]: connection on UNIX socket 

local3.debug: nfsen[494]: comm server started: 20143

local3.debug: nfsen[20143]: Cmd Decode: get-picture

local3.debug: nfsen[494]: comm child[20143] terminated with no exit value

phaag commented 1 month ago

in nfsen.conf set $SUBDIRLAYOUT correctly.

phaag commented 1 month ago

The compile flag --enable-devel is not meant for production and most likely does not help you here.

phaag commented 1 month ago

I cannot debug your installation from here! Check your logs, compare the old and new installation - check the nfcapd logs how many packets, bytes and flows have beed captured and so on .. You still have '-' in your names. This does not work.

Takalele commented 1 month ago

Hi @phaag

I've removed all hyphens from the sources and profile names. The $SUBDIRLAYOUT is identical between the old and new installations. Additionally, I've set up a third instance without tor and gelookup enabled and without any plugins. I've also created a custom profile that is identical across all instances. I'll check on Monday to see if there are any differences across the instances. If you have any tips or suggestions for me, I would greatly appreciate it. Thank you very much!

Takalele commented 2 weeks ago

@phaag I tested the releases between nfdump-1.6.25 - and nfdump-1.7.4, as well as the last commits of each month, until I found the specific commit where the issue started. https://github.com/phaag/nfdump/commit/9289f6a8addfd86cb9127d5943b71fe9931b12d1

For example, in NfSen, I observed that the issue occurred at 14:15. While the logs from that timestamp appear normal, at 14:20 the following error is logged:

Sep 19 14:20:15 nfprofile[23324]: stat() error '/data/nfsen/profiles-data/live/router1/nfcapd.202409191415': File not found!

I also tried adjusting the maxworker setting to 1 in an attempt to bypass the issue, but unfortunately, it had no effect. I have since reverted the setting. Do you have any suggestions on how to further investigate and debug this issue?

logs between 14:10 and 14:25

Sep 19 14:10:00 nfcapd[306]: Ident: 'fw1' Flows: 2439140, Packets: 242159152, Bytes: 241430461130, Sequence Errors: 117, Bad Packets: 0, Blocks: 1
Sep 19 14:10:00 nfcapd[306]: Total packets received: 11979160 avg: 39930.53 ignored packets: 0
Sep 19 14:10:00 nfcapd[246]: Ident: 'router2' Flows: 235290, Packets: 21912725, Bytes: 12658296075, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:10:00 nfcapd[292]: Ident: 'fw3_context1' Flows: 577575, Packets: 72205358, Bytes: 65244473168, Sequence Errors: 57, Bad Packets: 0, Blocks: 1
Sep 19 14:10:00 nfcapd[246]: Total packets received: 1100225 avg: 3667.42 ignored packets: 0
Sep 19 14:10:00 nfcapd[292]: Total packets received: 3187016 avg: 10623.39 ignored packets: 0
Sep 19 14:10:00 nfcapd[334]: Ident: 'dc_router1' Flows: 96419, Packets: 18971400, Bytes: 14075302500, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:10:00 nfcapd[334]: Total packets received: 291214 avg: 970.71 ignored packets: 0
Sep 19 14:10:00 nfcapd[253]: Ident: 'fw4_context1' Flows: 198, Packets: 1336, Bytes: 607862, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:10:00 nfcapd[327]: Ident: 'fw3_context2' Flows: 803139, Packets: 91241079, Bytes: 80477258990, Sequence Errors: 63, Bad Packets: 0, Blocks: 1
Sep 19 14:10:00 nfcapd[253]: Total packets received: 13910 avg: 46.37 ignored packets: 0
Sep 19 14:10:00 nfcapd[327]: Total packets received: 3828113 avg: 12760.38 ignored packets: 0
Sep 19 14:10:00 nfcapd[313]: Ident: 'router1' Flows: 561709, Packets: 175098575, Bytes: 145272029850, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:10:00 nfcapd[313]: Total packets received: 3045119 avg: 10150.40 ignored packets: 0
Sep 19 14:10:00 nfcapd[285]: Ident: 'fw2' Flows: 1693372, Packets: 217713569, Bytes: 170246822672, Sequence Errors: 70567, Bad Packets: 0, Blocks: 1
Sep 19 14:10:00 nfcapd[285]: Total packets received: 17253314 avg: 57511.05 ignored packets: 0
Sep 19 14:10:00 nfcapd[271]: Ident: 'fw4_context2' Flows: 2719, Packets: 631393, Bytes: 173662542, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:10:00 nfcapd[271]: Total packets received: 50214 avg: 167.38 ignored packets: 0
Sep 19 14:10:01 nfcapd[278]: Ident: 'fw5_context1' Flows: 28, Packets: 88, Bytes: 2886, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:10:01 nfcapd[278]: Total packets received: 1100 avg: 3.67 ignored packets: 0
Sep 19 14:10:01 nfcapd[299]: Ident: 'dc_router2' Flows: 164615, Packets: 52549100, Bytes: 45309148825, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:10:01 nfcapd[299]: Total packets received: 498720 avg: 1662.40 ignored packets: 0
Sep 19 14:10:01 nfcapd[320]: Ident: 'fw5_context2' Flows: 38, Packets: 104, Bytes: 3962, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:10:01 nfcapd[320]: Total packets received: 1799 avg: 6.00 ignored packets: 0
Sep 19 14:10:07 root: nfsen daemon is running
Sep 19 14:10:15 nfsen[340]: 12 channels/alerts to profile
Sep 19 14:10:15 nfprofile[22779]: Process line '.#real#2#router1#router1'
Sep 19 14:10:15 nfprofile[22779]: Process line '.#real#2#fw2#fw2'
Sep 19 14:10:15 nfprofile[22779]: Process line '.#real#2#fw3_context1#fw3_context1'
Sep 19 14:10:15 nfprofile[22779]: Process line '.#real#2#fw4_context1#fw4_context1'
Sep 19 14:10:15 nfprofile[22779]: Process line '.#real#2#fw1#fw1'
Sep 19 14:10:15 nfprofile[22779]: Process line '.#real#2#router2#router2'
Sep 19 14:10:15 nfprofile[22779]: Setup channel 'router1' in profile 'real' group '.', channellist 'router1'
Sep 19 14:10:15 nfprofile[22779]: Setup channel 'fw2' in profile 'real' group '.', channellist 'fw2'
Sep 19 14:10:15 nfprofile[22780]: Process line '.#real#2#dc_router1#dc_router1'
Sep 19 14:10:15 nfprofile[22780]: Process line '.#real#2#fw3_context2#fw3_context2'
Sep 19 14:10:15 nfprofile[22780]: Process line '.#real#2#fw5_context2#fw5_context2'
Sep 19 14:10:15 nfprofile[22780]: Process line '.#real#2#dc_router2#dc_router2'
Sep 19 14:10:15 nfprofile[22780]: Process line '.#real#2#fw4_context2#fw4_context2'
Sep 19 14:10:15 nfprofile[22780]: Process line '.#real#2#fw5_context1#fw5_context1'
Sep 19 14:10:15 nfprofile[22780]: Setup channel 'dc_router1' in profile 'real' group '.', channellist 'dc_router1'
Sep 19 14:10:15 nfprofile[22779]: Setup channel 'fw3_context1' in profile 'real' group '.', channellist 'fw3_context1'
Sep 19 14:10:15 nfprofile[22780]: Setup channel 'fw3_context2' in profile 'real' group '.', channellist 'fw3_context2'
Sep 19 14:10:15 nfprofile[22780]: Setup channel 'fw5_context2' in profile 'real' group '.', channellist 'fw5_context2'
Sep 19 14:10:15 nfprofile[22780]: Setup channel 'dc_router2' in profile 'real' group '.', channellist 'dc_router2'
Sep 19 14:10:15 nfprofile[22779]: Setup channel 'fw4_context1' in profile 'real' group '.', channellist 'fw4_context1'
Sep 19 14:10:15 nfprofile[22780]: Setup channel 'fw4_context2' in profile 'real' group '.', channellist 'fw4_context2'
Sep 19 14:10:15 nfprofile[22779]: Setup channel 'fw1' in profile 'real' group '.', channellist 'fw1'
Sep 19 14:10:15 nfprofile[22780]: Setup channel 'fw5_context1' in profile 'real' group '.', channellist 'fw5_context1'
Sep 19 14:10:15 nfprofile[22779]: Setup channel 'router2' in profile 'real' group '.', channellist 'router2'
Sep 19 14:10:15 nfprofile[22780]: CoresOnline: 10, Requested: 8, Set workers to: 8
Sep 19 14:10:15 nfprofile[22779]: CoresOnline: 10, Requested: 8, Set workers to: 8
Sep 19 14:10:24 nfsen[340]: Update profile live in group .
Sep 19 14:10:24 nfsen[340]: Update profile real in group .
Sep 19 14:10:24 nfsen[22883]: Run expire at Thu Sep 19 14:10:00 2024
Sep 19 14:10:24 nfsen[22884]: Plugin Cycle: Time: 202409191405, Profile: live, Group: ., Module: demoplugin, 
Sep 19 14:10:24 nfsen[22883]: Expire has 220s in this slot!
Sep 19 14:10:24 nfsen[22883]: Expire profile live group . low water mark: 90% 
Sep 19 14:10:24 nfsen[22884]: Plugin Cycle: Time: 202409191405, Profile: real, Group: ., Module: demoplugin, 
Sep 19 14:10:24 nfsen[22883]: Expire has 220s in this slot!
Sep 19 14:10:24 nfsen[22883]: Expire profile real group . low water mark: 90% 
Sep 19 14:10:24 nfsen[22883]: End expire at Thu Sep 19 14:10:00 2024
Sep 19 14:10:37 root: nfsen daemon is running
Sep 19 14:11:07 root: nfsen daemon is running
Sep 19 14:11:37 root: nfsen daemon is running
Sep 19 14:12:07 root: nfsen daemon is running
Sep 19 14:12:38 root: nfsen daemon is running
Sep 19 14:13:08 root: nfsen daemon is running
Sep 19 14:13:38 root: nfsen daemon is running
Sep 19 14:14:08 root: nfsen daemon is running
Sep 19 14:14:39 root: nfsen daemon is running
Sep 19 14:15:00 nfcapd[327]: Ident: 'fw3_context2' Flows: 762476, Packets: 95474016, Bytes: 86915565138, Sequence Errors: 72, Bad Packets: 0, Blocks: 1
Sep 19 14:15:00 nfcapd[327]: Total packets received: 3896739 avg: 12989.13 ignored packets: 0
Sep 19 14:15:00 nfcapd[292]: Ident: 'fw3_context1' Flows: 613449, Packets: 88484956, Bytes: 86186911549, Sequence Errors: 90, Bad Packets: 0, Blocks: 1
Sep 19 14:15:00 nfcapd[292]: Total packets received: 3241970 avg: 10806.57 ignored packets: 0
Sep 19 14:15:00 nfcapd[334]: Ident: 'dc_router1' Flows: 92749, Packets: 19648025, Bytes: 15695452900, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:15:00 nfcapd[334]: Total packets received: 294735 avg: 982.45 ignored packets: 0
Sep 19 14:15:00 nfcapd[246]: Ident: 'router2' Flows: 228412, Packets: 19746900, Bytes: 12020337650, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:15:00 nfcapd[246]: Total packets received: 1119087 avg: 3730.29 ignored packets: 0
Sep 19 14:15:00 nfcapd[285]: Ident: 'fw2' Flows: 1676471, Packets: 154993750, Bytes: 411390061782, Sequence Errors: 69811, Bad Packets: 0, Blocks: 1
Sep 19 14:15:00 nfcapd[285]: Total packets received: 17398835 avg: 57996.12 ignored packets: 0
Sep 19 14:15:00 nfcapd[306]: Ident: 'fw1' Flows: 2519982, Packets: 213310636, Bytes: 501882556203, Sequence Errors: 153, Bad Packets: 0, Blocks: 1
Sep 19 14:15:00 nfcapd[306]: Total packets received: 12147206 avg: 40490.69 ignored packets: 0
Sep 19 14:15:00 nfcapd[313]: Ident: 'router1' Flows: 556278, Packets: 174245425, Bytes: 149245995650, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:15:00 nfcapd[313]: Total packets received: 3073338 avg: 10244.46 ignored packets: 0
Sep 19 14:15:00 nfcapd[271]: Ident: 'fw4_context2' Flows: 2665, Packets: 96013, Bytes: 50632843, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:15:00 nfcapd[271]: Total packets received: 50858 avg: 169.53 ignored packets: 0
Sep 19 14:15:01 nfcapd[278]: Ident: 'fw5_context1' Flows: 22, Packets: 42, Bytes: 1558, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:15:01 nfcapd[278]: Total packets received: 1112 avg: 3.71 ignored packets: 0
Sep 19 14:15:01 nfcapd[299]: Ident: 'dc_router2' Flows: 153413, Packets: 52963925, Bytes: 45363301950, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:15:01 nfcapd[299]: Total packets received: 504297 avg: 1680.99 ignored packets: 0
Sep 19 14:15:01 nfcapd[253]: Ident: 'fw4_context1' Flows: 176, Packets: 36559193, Bytes: 19963061487, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:15:01 nfcapd[253]: Total packets received: 14005 avg: 46.68 ignored packets: 0
Sep 19 14:15:01 nfcapd[320]: Ident: 'fw5_context2' Flows: 30, Packets: 54, Bytes: 2142, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:15:01 nfcapd[320]: Total packets received: 1815 avg: 6.05 ignored packets: 0
Sep 19 14:15:09 root: nfsen daemon is running
Sep 19 14:15:15 nfsen[340]: 12 channels/alerts to profile
Sep 19 14:15:15 nfprofile[23054]: Process line '.#real#2#dc_router1#dc_router1'
Sep 19 14:15:15 nfprofile[23054]: Process line '.#real#2#router1#router1'
Sep 19 14:15:15 nfprofile[23054]: Process line '.#real#2#fw3_context1#fw3_context1'
Sep 19 14:15:15 nfprofile[23054]: Process line '.#real#2#fw5_context1#fw5_context1'
Sep 19 14:15:15 nfprofile[23054]: Process line '.#real#2#dc_router2#dc_router2'
Sep 19 14:15:15 nfprofile[23054]: Process line '.#real#2#fw4_context1#fw4_context1'
Sep 19 14:15:15 nfprofile[23054]: Setup channel 'dc_router1' in profile 'real' group '.', channellist 'dc_router1'
Sep 19 14:15:15 nfprofile[23054]: Setup channel 'router1' in profile 'real' group '.', channellist 'router1'
Sep 19 14:15:15 nfprofile[23052]: Process line '.#real#2#fw3_context2#fw3_context2'
Sep 19 14:15:15 nfprofile[23052]: Process line '.#real#2#fw2#fw2'
Sep 19 14:15:15 nfprofile[23052]: Process line '.#real#2#router2#router2'
Sep 19 14:15:15 nfprofile[23052]: Process line '.#real#2#fw4_context2#fw4_context2'
Sep 19 14:15:15 nfprofile[23052]: Process line '.#real#2#fw1#fw1'
Sep 19 14:15:15 nfprofile[23052]: Process line '.#real#2#fw5_context2#fw5_context2'
Sep 19 14:15:15 nfprofile[23052]: Setup channel 'fw3_context2' in profile 'real' group '.', channellist 'fw3_context2'
Sep 19 14:15:15 nfprofile[23054]: Setup channel 'fw3_context1' in profile 'real' group '.', channellist 'fw3_context1'
Sep 19 14:15:15 nfprofile[23054]: Setup channel 'fw5_context1' in profile 'real' group '.', channellist 'fw5_context1'
Sep 19 14:15:15 nfprofile[23052]: Setup channel 'fw2' in profile 'real' group '.', channellist 'fw2'
Sep 19 14:15:15 nfprofile[23054]: Setup channel 'dc_router2' in profile 'real' group '.', channellist 'dc_router2'
Sep 19 14:15:15 nfprofile[23052]: Setup channel 'router2' in profile 'real' group '.', channellist 'router2'
Sep 19 14:15:15 nfprofile[23054]: Setup channel 'fw4_context1' in profile 'real' group '.', channellist 'fw4_context1'
Sep 19 14:15:15 nfprofile[23054]: CoresOnline: 10, Requested: 8, Set workers to: 8
Sep 19 14:15:15 nfprofile[23052]: Setup channel 'fw4_context2' in profile 'real' group '.', channellist 'fw4_context2'
Sep 19 14:15:15 nfprofile[23052]: Setup channel 'fw1' in profile 'real' group '.', channellist 'fw1'
Sep 19 14:15:15 nfprofile[23052]: Setup channel 'fw5_context2' in profile 'real' group '.', channellist 'fw5_context2'
Sep 19 14:15:15 nfprofile[23052]: CoresOnline: 10, Requested: 8, Set workers to: 8
Sep 19 14:15:26 nfsen[340]: Update profile live in group .
Sep 19 14:15:26 nfsen[340]: Update profile real in group .
Sep 19 14:15:27 nfsen[23159]: Run expire at Thu Sep 19 14:15:00 2024
Sep 19 14:15:27 nfsen[23160]: Plugin Cycle: Time: 202409191410, Profile: live, Group: ., Module: demoplugin, 
Sep 19 14:15:27 nfsen[23159]: Expire has 218s in this slot!
Sep 19 14:15:27 nfsen[23159]: Expire profile live group . low water mark: 90% 
Sep 19 14:15:27 nfsen[23160]: Plugin Cycle: Time: 202409191410, Profile: real, Group: ., Module: demoplugin, 
Sep 19 14:15:27 nfsen[23159]: Expire has 218s in this slot!
Sep 19 14:15:27 nfsen[23159]: Expire profile real group . low water mark: 90% 
Sep 19 14:15:27 nfsen[23159]: End expire at Thu Sep 19 14:15:00 2024
Sep 19 14:15:39 root: nfsen daemon is running
Sep 19 14:16:09 root: nfsen daemon is running
Sep 19 14:16:39 root: nfsen daemon is running
Sep 19 14:17:10 root: nfsen daemon is running
Sep 19 14:17:40 root: nfsen daemon is running
Sep 19 14:18:10 root: nfsen daemon is running
Sep 19 14:18:40 root: nfsen daemon is running
Sep 19 14:19:11 root: nfsen daemon is running
Sep 19 14:19:41 root: nfsen daemon is running
Sep 19 14:20:00 nfcapd[253]: Ident: 'fw4_context1' Flows: 164, Packets: 374, Bytes: 40221, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[253]: Total packets received: 14093 avg: 46.98 ignored packets: 0
Sep 19 14:20:00 nfcapd[292]: Ident: 'fw3_context1' Flows: 575369, Packets: 62023542, Bytes: 56217522293, Sequence Errors: 101, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[292]: Total packets received: 3293603 avg: 10978.68 ignored packets: 0
Sep 19 14:20:00 nfcapd[327]: Ident: 'fw3_context2' Flows: 762538, Packets: 86316717, Bytes: 75016098548, Sequence Errors: 114, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[327]: Total packets received: 3965341 avg: 13217.80 ignored packets: 0
Sep 19 14:20:00 nfcapd[334]: Ident: 'dc_router1' Flows: 91611, Packets: 19216425, Bytes: 15338091625, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[334]: Total packets received: 298239 avg: 994.13 ignored packets: 0
Sep 19 14:20:00 nfcapd[246]: Ident: 'router2' Flows: 225218, Packets: 19261800, Bytes: 10905510800, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[246]: Total packets received: 1137603 avg: 3792.01 ignored packets: 0
Sep 19 14:20:00 nfcapd[285]: Ident: 'fw2' Flows: 1748227, Packets: 215193207, Bytes: 191918346057, Sequence Errors: 72369, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[306]: Ident: 'fw1' Flows: 2432433, Packets: 165567674, Bytes: 206430687478, Sequence Errors: 132, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[285]: Total packets received: 17550145 avg: 58500.48 ignored packets: 0
Sep 19 14:20:00 nfcapd[306]: Total packets received: 12309654 avg: 41032.18 ignored packets: 0
Sep 19 14:20:00 nfcapd[313]: Ident: 'router1' Flows: 550767, Packets: 171868775, Bytes: 148893928225, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[313]: Total packets received: 3101314 avg: 10337.71 ignored packets: 0
Sep 19 14:20:00 nfcapd[320]: Ident: 'fw5_context2' Flows: 24, Packets: 28, Bytes: 1328, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[320]: Total packets received: 1828 avg: 6.09 ignored packets: 0
Sep 19 14:20:00 nfcapd[278]: Ident: 'fw5_context1' Flows: 22, Packets: 22, Bytes: 872, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[278]: Total packets received: 1123 avg: 3.74 ignored packets: 0
Sep 19 14:20:00 nfcapd[271]: Ident: 'fw4_context2' Flows: 2712, Packets: 123027, Bytes: 73228796, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:20:00 nfcapd[271]: Total packets received: 51498 avg: 171.66 ignored packets: 0
Sep 19 14:20:01 nfcapd[299]: Ident: 'dc_router2' Flows: 164129, Packets: 57259650, Bytes: 51399419350, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:20:01 nfcapd[299]: Total packets received: 510194 avg: 1700.65 ignored packets: 0
Sep 19 14:20:11 root: nfsen daemon is running
Sep 19 14:20:15 nfsen[340]: 12 channels/alerts to profile
Sep 19 14:20:15 nfprofile[23326]: Process line '.#real#2#fw3_context2#fw3_context2'
Sep 19 14:20:15 nfprofile[23326]: Process line '.#real#2#router2#router2'
Sep 19 14:20:15 nfprofile[23326]: Process line '.#real#2#fw5_context2#fw5_context2'
Sep 19 14:20:15 nfprofile[23326]: Process line '.#real#2#fw1#fw1'
Sep 19 14:20:15 nfprofile[23326]: Process line '.#real#2#fw3_context1#fw3_context1'
Sep 19 14:20:15 nfprofile[23326]: Process line '.#real#2#dc_router1#dc_router1'
Sep 19 14:20:15 nfprofile[23326]: Setup channel 'fw3_context2' in profile 'real' group '.', channellist 'fw3_context2'
Sep 19 14:20:15 nfprofile[23326]: Setup channel 'router2' in profile 'real' group '.', channellist 'router2'
Sep 19 14:20:15 nfprofile[23326]: Setup channel 'fw5_context2' in profile 'real' group '.', channellist 'fw5_context2'
Sep 19 14:20:15 nfprofile[23326]: Setup channel 'fw1' in profile 'real' group '.', channellist 'fw1'
Sep 19 14:20:15 nfprofile[23324]: Process line '.#real#2#fw4_context2#fw4_context2'
Sep 19 14:20:15 nfprofile[23324]: Process line '.#real#2#fw5_context1#fw5_context1'
Sep 19 14:20:15 nfprofile[23324]: Process line '.#real#2#dc_router2#dc_router2'
Sep 19 14:20:15 nfprofile[23324]: Process line '.#real#2#fw4_context1#fw4_context1'
Sep 19 14:20:15 nfprofile[23324]: Process line '.#real#2#fw2#fw2'
Sep 19 14:20:15 nfprofile[23324]: Process line '.#real#2#router1#router1'
Sep 19 14:20:15 nfprofile[23324]: Setup channel 'fw4_context2' in profile 'real' group '.', channellist 'fw4_context2'
Sep 19 14:20:15 nfprofile[23324]: stat() error '/data/nfsen/profiles-data/live/router1/nfcapd.202409191415': File not found!
Sep 19 14:20:15 nfprofile[23324]: Setup channel 'fw5_context1' in profile 'real' group '.', channellist 'fw5_context1'
Sep 19 14:20:15 nfprofile[23326]: Setup channel 'fw3_context1' in profile 'real' group '.', channellist 'fw3_context1'
Sep 19 14:20:15 nfprofile[23324]: Setup channel 'dc_router2' in profile 'real' group '.', channellist 'dc_router2'
Sep 19 14:20:15 nfprofile[23326]: Setup channel 'dc_router1' in profile 'real' group '.', channellist 'dc_router1'
Sep 19 14:20:15 nfprofile[23324]: Setup channel 'fw4_context1' in profile 'real' group '.', channellist 'fw4_context1'
Sep 19 14:20:15 nfprofile[23326]: CoresOnline: 10, Requested: 8, Set workers to: 8
Sep 19 14:20:15 nfprofile[23324]: Setup channel 'fw2' in profile 'real' group '.', channellist 'fw2'
Sep 19 14:20:15 nfprofile[23324]: Setup channel 'router1' in profile 'real' group '.', channellist 'router1'
Sep 19 14:20:15 nfprofile[23324]: CoresOnline: 10, Requested: 8, Set workers to: 8
Sep 19 14:20:24 nfsen[340]: Update profile live in group .
Sep 19 14:20:24 nfsen[340]: Update profile real in group .
Sep 19 14:20:24 nfsen[23428]: Run expire at Thu Sep 19 14:20:00 2024
Sep 19 14:20:24 nfsen[23429]: Plugin Cycle: Time: 202409191415, Profile: live, Group: ., Module: demoplugin, 
Sep 19 14:20:24 nfsen[23428]: Expire has 220s in this slot!
Sep 19 14:20:24 nfsen[23428]: Expire profile live group . low water mark: 90% 
Sep 19 14:20:24 nfsen[23429]: Plugin Cycle: Time: 202409191415, Profile: real, Group: ., Module: demoplugin, 
Sep 19 14:20:24 nfsen[23428]: Expire has 220s in this slot!
Sep 19 14:20:24 nfsen[23428]: Expire profile real group . low water mark: 90% 
Sep 19 14:20:24 nfsen[23428]: End expire at Thu Sep 19 14:20:00 2024
Sep 19 14:20:41 root: nfsen daemon is running
Sep 19 14:21:11 root: nfsen daemon is running
Sep 19 14:21:42 root: nfsen daemon is running
Sep 19 14:22:12 root: nfsen daemon is running
Sep 19 14:22:42 root: nfsen daemon is running
Sep 19 14:23:12 root: nfsen daemon is running
Sep 19 14:23:43 root: nfsen daemon is running
Sep 19 14:24:13 root: nfsen daemon is running
Sep 19 14:24:43 root: nfsen daemon is running
Sep 19 14:25:00 nfcapd[285]: Ident: 'fw2' Flows: 1707082, Packets: 220698457, Bytes: 185137444185, Sequence Errors: 71224, Bad Packets: 0, Blocks: 1
Sep 19 14:25:00 nfcapd[285]: Total packets received: 17697944 avg: 58993.15 ignored packets: 0
Sep 19 14:25:00 nfcapd[334]: Ident: 'dc_router1' Flows: 94036, Packets: 19321225, Bytes: 15122175925, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:25:00 nfcapd[334]: Total packets received: 301769 avg: 1005.90 ignored packets: 0
Sep 19 14:25:00 nfcapd[292]: Ident: 'fw3_context1' Flows: 593735, Packets: 53225666, Bytes: 44808325543, Sequence Errors: 113, Bad Packets: 0, Blocks: 1
Sep 19 14:25:00 nfcapd[327]: Ident: 'fw3_context2' Flows: 705886, Packets: 84930861, Bytes: 75180126049, Sequence Errors: 111, Bad Packets: 0, Blocks: 1
Sep 19 14:25:00 nfcapd[327]: Total packets received: 4028965 avg: 13429.88 ignored packets: 0
Sep 19 14:25:00 nfcapd[292]: Total packets received: 3346774 avg: 11155.91 ignored packets: 0
Sep 19 14:25:00 nfcapd[306]: Ident: 'fw1' Flows: 2459214, Packets: 192320285, Bytes: 175238739366, Sequence Errors: 114, Bad Packets: 0, Blocks: 1
Sep 19 14:25:00 nfcapd[306]: Total packets received: 12473795 avg: 41579.32 ignored packets: 0
Sep 19 14:25:00 nfcapd[246]: Ident: 'router2' Flows: 231555, Packets: 21464100, Bytes: 13462638950, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:25:00 nfcapd[246]: Total packets received: 1156705 avg: 3855.68 ignored packets: 0
Sep 19 14:25:00 nfcapd[253]: Ident: 'fw4_context1' Flows: 214, Packets: 3319, Bytes: 2462229, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:25:00 nfcapd[253]: Total packets received: 14208 avg: 47.36 ignored packets: 0
Sep 19 14:25:00 nfcapd[313]: Ident: 'router1' Flows: 556538, Packets: 183729950, Bytes: 157610845125, Sequence Errors: 6, Bad Packets: 0, Blocks: 1
Sep 19 14:25:00 nfcapd[313]: Total packets received: 3129593 avg: 10431.98 ignored packets: 0
Sep 19 14:25:01 nfcapd[271]: Ident: 'fw4_context2' Flows: 2719, Packets: 100093, Bytes: 43601422, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:25:01 nfcapd[271]: Total packets received: 52141 avg: 173.80 ignored packets: 0
Sep 19 14:25:01 nfcapd[299]: Ident: 'dc_router2' Flows: 153194, Packets: 52888925, Bytes: 46193570025, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:25:01 nfcapd[299]: Total packets received: 515775 avg: 1719.25 ignored packets: 0
Sep 19 14:25:01 nfcapd[278]: Ident: 'fw5_context1' Flows: 46, Packets: 94, Bytes: 2838, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:25:01 nfcapd[278]: Total packets received: 1142 avg: 3.81 ignored packets: 0
Sep 19 14:25:01 nfcapd[320]: Ident: 'fw5_context2' Flows: 36, Packets: 86, Bytes: 3288, Sequence Errors: 0, Bad Packets: 0, Blocks: 1
Sep 19 14:25:01 nfcapd[320]: Total packets received: 1845 avg: 6.15 ignored packets: 0
Sep 19 14:25:13 root: nfsen daemon is running
Sep 19 14:25:15 nfsen[340]: 12 channels/alerts to profile
Sep 19 14:25:15 nfprofile[23593]: Process line '.#real#2#router1#router1'
Sep 19 14:25:15 nfprofile[23593]: Process line '.#real#2#fw3_context1#fw3_context1'
Sep 19 14:25:15 nfprofile[23593]: Process line '.#real#2#fw5_context1#fw5_context1'
Sep 19 14:25:15 nfprofile[23593]: Process line '.#real#2#fw4_context1#fw4_context1'
Sep 19 14:25:15 nfprofile[23593]: Process line '.#real#2#fw1#fw1'
Sep 19 14:25:15 nfprofile[23593]: Process line '.#real#2#fw3_context2#fw3_context2'
Sep 19 14:25:15 nfprofile[23593]: Setup channel 'router1' in profile 'real' group '.', channellist 'router1'
Sep 19 14:25:15 nfprofile[23593]: Setup channel 'fw3_context1' in profile 'real' group '.', channellist 'fw3_context1'
Sep 19 14:25:15 nfprofile[23596]: Process line '.#real#2#dc_router1#dc_router1'
Sep 19 14:25:15 nfprofile[23596]: Process line '.#real#2#fw2#fw2'
Sep 19 14:25:15 nfprofile[23596]: Process line '.#real#2#router2#router2'
Sep 19 14:25:15 nfprofile[23596]: Process line '.#real#2#fw4_context2#fw4_context2'
Sep 19 14:25:15 nfprofile[23596]: Process line '.#real#2#dc_router2#dc_router2'
Sep 19 14:25:15 nfprofile[23596]: Process line '.#real#2#fw5_context2#fw5_context2'
Sep 19 14:25:15 nfprofile[23596]: Setup channel 'dc_router1' in profile 'real' group '.', channellist 'dc_router1'
Sep 19 14:25:15 nfprofile[23596]: Setup channel 'fw2' in profile 'real' group '.', channellist 'fw2'
Sep 19 14:25:15 nfprofile[23593]: Setup channel 'fw5_context1' in profile 'real' group '.', channellist 'fw5_context1'
Sep 19 14:25:15 nfprofile[23596]: Setup channel 'router2' in profile 'real' group '.', channellist 'router2'
Sep 19 14:25:15 nfprofile[23593]: Setup channel 'fw4_context1' in profile 'real' group '.', channellist 'fw4_context1'
Sep 19 14:25:15 nfprofile[23596]: Setup channel 'fw4_context2' in profile 'real' group '.', channellist 'fw4_context2'
Sep 19 14:25:15 nfprofile[23593]: Setup channel 'fw1' in profile 'real' group '.', channellist 'fw1'
Sep 19 14:25:15 nfprofile[23596]: Setup channel 'dc_router2' in profile 'real' group '.', channellist 'dc_router2'
Sep 19 14:25:15 nfprofile[23596]: Setup channel 'fw5_context2' in profile 'real' group '.', channellist 'fw5_context2'
Sep 19 14:25:15 nfprofile[23593]: Setup channel 'fw3_context2' in profile 'real' group '.', channellist 'fw3_context2'
Sep 19 14:25:15 nfprofile[23596]: CoresOnline: 10, Requested: 8, Set workers to: 8
Sep 19 14:25:15 nfprofile[23593]: CoresOnline: 10, Requested: 8, Set workers to: 8
Sep 19 14:25:24 nfsen[340]: Update profile live in group .
Sep 19 14:25:25 nfsen[340]: Update profile real in group .
Sep 19 14:25:25 nfsen[23699]: Run expire at Thu Sep 19 14:25:00 2024
Sep 19 14:25:25 nfsen[23699]: Expire has 220s in this slot!
Sep 19 14:25:25 nfsen[23699]: Expire profile live group . low water mark: 90% 
Sep 19 14:25:25 nfsen[23700]: Plugin Cycle: Time: 202409191420, Profile: live, Group: ., Module: demoplugin, 
Sep 19 14:25:25 nfsen[23700]: Plugin Cycle: Time: 202409191420, Profile: real, Group: ., Module: demoplugin, 
Sep 19 14:25:25 nfsen[23699]: Expire has 220s in this slot!
Sep 19 14:25:25 nfsen[23699]: Expire profile real group . low water mark: 90% 
Sep 19 14:25:25 nfsen[23699]: End expire at Thu Sep 19 14:25:00 2024

BR Takalele

phaag / nfsen

nfcapd / nfprofile nfcapd.JJJJMMDDHHMM: File not found! #40