Closed nygc-jmaldonado closed 3 years ago
Show nprobe and ntopng config used please
NTOP
-bash-4.2$ cat /etc/nt ntopng/ ntopng.license ntp/ ntp.conf -bash-4.2$ cat /etc/ntopng/ntopng.conf
# #
#
-G=/var/run/ntopng.pid --online-license-check
#
--daemon
#
#
--interface="tcp://10.1.28.91:5556"
#
#
#
#
#
--local-networks="10.0.0.0/8, 172.16.0.0/20, 192.168.0.0/16"
#
#
#
#
#
#
#
#
--max-num-flows=200000 --max-num-hosts=250000 --enable-aggregations -bash-4.2$
This message is for the recipient’s use only, and may contain confidential, privileged or protected information. Any unauthorized use or dissemination of this communication is prohibited. If you received this message in error, please immediately notify the sender and destroy all copies of this message. The recipient should check this email and any attachments for the presence of viruses, as we accept no liability for any damage caused by any virus transmitted by this email.
NPROBE
-bash-4.2$ cat /etc/nprobe/nprobe cat: /etc/nprobe/nprobe: No such file or directory -bash-4.2$ cat /etc/nprobe/nprobe nprobe.conf nprobe.conf.ntopng.sample nprobe-eth0.conf nprobe-none.conf nprobe-none.start.migrated -bash-4.2$ cat /etc/nprobe/nprobe.conf
# #
--online-license-check -i=none
--zmq="tcp://*:5556" -3=2055
# #
#
#
#
#
#
#
#
#
# -bash-4.2$
From: Simone Mainardi notifications@github.com Reply-To: ntop/ntopng reply@reply.github.com Date: Thursday, January 14, 2021 at 2:59 AM To: ntop/ntopng ntopng@noreply.github.com Cc: Justin Maldonado jmaldonado@NYGENOME.ORG, Author author@noreply.github.com Subject: Re: [ntop/ntopng] Have 2 ASA's with identical configs; only 1 ASA appears in NTOP (#4910)
Show nprobe and ntopng config used please
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/ntop/ntopng/issues/4910*issuecomment-760002313__;Iw!!C6sPl7C9qQ!GsCFF7nqRi752rHgZOlvG_MmF_QrTjiRFbMcUPpgcwzqXCE1Erf6tciB-vLB7TmDY5g$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/AH7JEH25RMIDQN6U2ZB3VA3SZ2P67ANCNFSM4WCAOI6Q__;!!C6sPl7C9qQ!GsCFF7nqRi752rHgZOlvG_MmF_QrTjiRFbMcUPpgcwzqXCE1Erf6tciB-vLBrLnordk$.
This message is for the recipient’s use only, and may contain confidential, privileged or protected information. Any unauthorized use or dissemination of this communication is prohibited. If you received this message in error, please immediately notify the sender and destroy all copies of this message. The recipient should check this email and any attachments for the presence of viruses, as we accept no liability for any damage caused by any virus transmitted by this email.
Visit the interface page under ntopng. See if collected ZMQ messages increase or if it stays at zero. This will allow us to understand if nprobe and ntopng can communicate correctly.
Collected messages are increasing
Get Outlook for iOShttps://aka.ms/o0ukef
From: Simone Mainardi notifications@github.com Sent: Thursday, January 14, 2021 5:03:38 AM To: ntop/ntopng ntopng@noreply.github.com Cc: Justin Maldonado jmaldonado@nygenome.org; Author author@noreply.github.com Subject: Re: [ntop/ntopng] Have 2 ASA's with identical configs; only 1 ASA appears in NTOP (#4910)
Visit the interface page under ntopng. See if collected ZMQ messages increase or if it stays at zero. This will allow us to understand if nprobe and ntopng can communicate correctly.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https://github.com/ntop/ntopng/issues/4910*issuecomment-760092218__;Iw!!C6sPl7C9qQ!CCrniECSSb2tIJkzdf-CZcnN7AFBEGjK24gGskLKNUBmJYxaW8mje5tdM8d8TeM2WKs$, or unsubscribehttps://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/AH7JEH4RMJWIGAIXLDWJOYLSZ26PVANCNFSM4WCAOI6Q__;!!C6sPl7C9qQ!CCrniECSSb2tIJkzdf-CZcnN7AFBEGjK24gGskLKNUBmJYxaW8mje5tdM8d8914-79I$.
This message is for the recipient’s use only, and may contain confidential, privileged or protected information. Any unauthorized use or dissemination of this communication is prohibited. If you received this message in error, please immediately notify the sender and destroy all copies of this message. The recipient should check this email and any attachments for the presence of viruses, as we accept no liability for any damage caused by any virus transmitted by this email.
Also to note, 1 ASA ( 5555 ) appears and disappears from the list of flow exporters. The other ASA ( 5585-x SSP-40) never appears. Configs are identical.
Nprobe sees the traffic from both.
From: Simone Mainardi notifications@github.com Reply-To: ntop/ntopng reply@reply.github.com Date: Thursday, January 14, 2021 at 5:03 AM To: ntop/ntopng ntopng@noreply.github.com Cc: Justin Maldonado jmaldonado@NYGENOME.ORG, Author author@noreply.github.com Subject: Re: [ntop/ntopng] Have 2 ASA's with identical configs; only 1 ASA appears in NTOP (#4910)
Visit the interface page under ntopng. See if collected ZMQ messages increase or if it stays at zero. This will allow us to understand if nprobe and ntopng can communicate correctly.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/ntop/ntopng/issues/4910*issuecomment-760092218__;Iw!!C6sPl7C9qQ!CCrniECSSb2tIJkzdf-CZcnN7AFBEGjK24gGskLKNUBmJYxaW8mje5tdM8d8TeM2WKs$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/AH7JEH4RMJWIGAIXLDWJOYLSZ26PVANCNFSM4WCAOI6Q__;!!C6sPl7C9qQ!CCrniECSSb2tIJkzdf-CZcnN7AFBEGjK24gGskLKNUBmJYxaW8mje5tdM8d8914-79I$.
This message is for the recipient’s use only, and may contain confidential, privileged or protected information. Any unauthorized use or dissemination of this communication is prohibited. If you received this message in error, please immediately notify the sender and destroy all copies of this message. The recipient should check this email and any attachments for the presence of viruses, as we accept no liability for any damage caused by any virus transmitted by this email.
Do you want to jump on a webex ?
Hey there,
Any ideas as to what this could be ?
Attach ntopng and nprobe configs
Both configs attached are attached.
From: Simone Mainardi notifications@github.com Sent: Monday, January 18, 2021 6:38 AM To: ntop/ntopng Cc: Justin Maldonado; Author Subject: Re: [ntop/ntopng] Have 2 ASA's with identical configs; only 1 ASA appears in NTOP (#4910)
Attach ntopng and nprobe configs
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https://github.com/ntop/ntopng/issues/4910*issuecomment-762192803__;Iw!!C6sPl7C9qQ!BvZd7ISzRmCjUuCpfk71jVEiyCY-14Mwj1PgCIpxskNTx43SrDPM-PJ59nVHwgqqFL0$, or unsubscribehttps://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/AH7JEH4XXLEGBI6ZH3TUUGDS2QMRVANCNFSM4WCAOI6Q__;!!C6sPl7C9qQ!BvZd7ISzRmCjUuCpfk71jVEiyCY-14Mwj1PgCIpxskNTx43SrDPM-PJ59nVHQXiYOqY$.
This message is for the recipient’s use only, and may contain confidential, privileged or protected information. Any unauthorized use or dissemination of this communication is prohibited. If you received this message in error, please immediately notify the sender and destroy all copies of this message. The recipient should check this email and any attachments for the presence of viruses, as we accept no liability for any damage caused by any virus transmitted by this email.
-bash-4.2$ cat /etc/ntopng/ntopng.conf
# #
#
-G=/var/run/ntopng.pid --online-license-check
#
--daemon
#
#
--interface="tcp://10.1.28.91:5556"
#
#
#
#
#
--local-networks="10.0.0.0/8, 172.16.0.0/20, 192.168.0.0/16"
#
#
#
#
#
#
#
#
--max-num-flows=200000 --max-num-hosts=250000 --enable-aggregations
cat /etc/nprobe/nprobe.conf
[root@nprobe ~]# cat /etc/nprobe/nprobe.conf
# #
--online-license-check -i=none
--zmq="tcp://*:5556" -3=2055
# #
#
#
#
#
#
#
#
#
Jump on the nprobe machine and execute 1 minute each command
sudo tcpdump -nnei <incoming netflow interface> udp and port 2055 and host <IP of the first asa> -s0 -w first_asa.pcap
sudo tcpdump -nnei <incoming netflow interface> udp and port 2055 and host <IP of the second asa> -s0 -w second_asa.pcap
Then, send me those files for inspection. My guess is that you are not getting data or templates and so nProbe doesn't know how to interpret NetFlow. You can send using mainardi at ntop dot org
Second ASA seems not to be reporting templates as we have verified via the pcap provided
Without templates, it is impossible for nProbe to parse NetFlow. Check the ASA, make sure it exports templates periodically, every 10-30 seconds.
Both are configured identically, neither is showing up in ntopng. The only difference is what interface the ASA chooses to send packets out.
1st ASA
access-list flow_export_acl extended permit ip any any
flow-export destination inside 10.1.x.91 2055 flow-export template timeout-rate 5 flow-export active refresh-interval 1
class-map flow_export_class match access-list flow_export_acl class flow_export_class flow-export event-type all destination 10.1.x.91
2nd ASA
access-list flow_export_acl extended permit ip any any log
flow-export destination management 10.1.x.912055 flow-export template timeout-rate 5 flow-export active refresh-interval 1
class-map flow_export_class match access-list flow_export_acl class flow_export_class flow-export event-type all destination 10.1.x.91
From: Simone Mainardi notifications@github.com Reply-To: ntop/ntopng reply@reply.github.com Date: Monday, January 25, 2021 at 4:48 AM To: ntop/ntopng ntopng@noreply.github.com Cc: Justin Maldonado jmaldonado@NYGENOME.ORG, Author author@noreply.github.com Subject: Re: [ntop/ntopng] Have 2 ASA's with identical configs; only 1 ASA appears in NTOP (#4910)
Second ASA seems not to be reporting templates as we have verified via the pcap provided
Without templates, it is impossible for nProbe to parse NetFlow. Check the ASA, make sure it exports templates periodically, every 10-30 seconds.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/ntop/ntopng/issues/4910*issuecomment-766692023__;Iw!!C6sPl7C9qQ!Dqa8ImCBhUfbawx7nSaIymvvNXkw3nENalsh45MFeClXIRzEjGMuFcKhBqDLV86vKRY$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/AH7JEHZJHIGBYN4AYVZTOZ3S3U47LANCNFSM4WCAOI6Q__;!!C6sPl7C9qQ!Dqa8ImCBhUfbawx7nSaIymvvNXkw3nENalsh45MFeClXIRzEjGMuFcKhBqDLnlggycw$.
This message is for the recipient’s use only, and may contain confidential, privileged or protected information. Any unauthorized use or dissemination of this communication is prohibited. If you received this message in error, please immediately notify the sender and destroy all copies of this message. The recipient should check this email and any attachments for the presence of viruses, as we accept no liability for any damage caused by any virus transmitted by this email.
I am not familiar with ASA but unless you configure them to export templates, there's no way for nprobe to parse their netflow. Can you check this?
Templates ae being sent. This is what I get when I start nprobe.
[root@nprobe ~]# nprobe /etc/nprobe/nprobe.conf 27/Jan/2021 08:41:03 [nprobe.c:5044] Reading configuration file /etc/nprobe/nprobe.conf 27/Jan/2021 08:41:03 [plugin.c:177] No plugins found in ./plugins 27/Jan/2021 08:41:03 [plugin.c:185] Loading 23 plugins [.so] from /usr/local/lib/nprobe/plugins 27/Jan/2021 08:41:03 [nprobe.c:2462] Contacting licensing server. Please hold on... 27/Jan/2021 08:41:05 [nprobe.c:4623] Valid nProbe Pro license found 27/Jan/2021 08:41:05 [nprobe.c:6675] WARNING: The output interfaceId is set to 0: did you forget to use -Q perhaps ? 27/Jan/2021 08:41:05 [nprobe.c:6678] WARNING: The input interfaceId is set to 0: did you forget to use -u perhaps ? 27/Jan/2021 08:41:05 [nprobe.c:6684] WARNING: You have specified --zmq and not specified -n. 27/Jan/2021 08:41:05 [nprobe.c:6685] WARNING: We believe you want to use just ZMQ and no netflow export 27/Jan/2021 08:41:05 [nprobe.c:6686] WARNING: Setting flow export to -n none 27/Jan/2021 08:41:05 [nprobe.c:6765] Welcome to Pro nProbe v.9.0.200522 ($Revision: 6820 $) for x86_64-unknown-linux-gnu with native PF_RING acceleration 27/Jan/2021 08:41:05 [nprobe.c:6776] Running on CentOS Linux release 7.7.1908 (Core) 27/Jan/2021 08:41:05 [nprobe.c:6787] [LICENSE] nProbe SystemId: 688FBED676066B1F 27/Jan/2021 08:41:05 [nprobe.c:6858] Sample rate [packet: 1][flow collection/export: 1/1]
27/Jan/2021 08:41:05 [nprobe.c:9707] Welcome to nProbe v.9.0.200522 for x86_64-unknown-linux-gnu 27/Jan/2021 08:41:05 [nprobe.c:8664] Using default template %IN_SRC_MAC %OUT_DST_MAC %INPUT_SNMP %OUTPUT_SNMP %SRC_VLAN %IPV4_SRC_ADDR %IPV4_DST_ADDR %L4_SRC_PORT %L4_DST_PORT %IPV6_SRC_ADDR %IPV6_DST_ADDR %IP_PROTOCOL_VERSION %PROTOCOL %L7_PROTO %IN_BYTES %IN_PKTS %OUT_BYTES %OUT_PKTS %FIRST_SWITCHED %LAST_SWITCHED %CLIENT_TCP_FLAGS %SERVER_TCP_FLAGS 27/Jan/2021 08:41:05 [nprobe.c:8551] WARNING: Adding %EXPORTER_IPV4_ADDRESS to the template as nProbe is working as collector
27/Jan/2021 08:41:05 [nprobe.c:8669] Using NetFlow Packet Payload Len: 1472
27/Jan/2021 08:41:05 [nprobe.c:8704] Flow export type: bidirectional flows 27/Jan/2021 08:41:05 [plugin.c:1309] 0 plugin(s) enabled 27/Jan/2021 08:41:05 [nprobe.c:9142] Each flow is 104 bytes long 27/Jan/2021 08:41:05 [nprobe.c:9143] The # flows per packet has been set to 13 27/Jan/2021 08:41:05 [nprobe.c:9146] IP TOS is ignored 27/Jan/2021 08:41:05 [nprobe.c:9990] Flows ASs will not be computed (no GeoDB files loaded) 27/Jan/2021 08:41:05 [nprobe.c:10095] Not capturing packet from interface (collector mode) 27/Jan/2021 08:41:05 [util.c:5025] Initializing ZMQ as server 27/Jan/2021 08:41:05 [util.c:5102] ERROR: Unable to bind ZMQ endpoint tcp://*:5556: Address already in use 27/Jan/2021 08:41:05 [util.c:4033] Enlarged socket buffer [echo 8388608 > /proc/sys/net/core/rmem_max] 27/Jan/2021 08:41:05 [util.c:4074] nProbe changed user to 'nprobe' 27/Jan/2021 08:41:05 [collect.c:192] Flow collector listening on port 2055 (IPv4/v6) 27/Jan/2021 08:41:05 [export.c:543] Using TLV as serialization format 27/Jan/2021 08:41:05 [nprobe.c:10361] nProbe started successfully
From: Simone Mainardi notifications@github.com Reply-To: ntop/ntopng reply@reply.github.com Date: Monday, January 25, 2021 at 12:04 PM To: ntop/ntopng ntopng@noreply.github.com Cc: Justin Maldonado jmaldonado@NYGENOME.ORG, Author author@noreply.github.com Subject: Re: [ntop/ntopng] Have 2 ASA's with identical configs; only 1 ASA appears in NTOP (#4910)
I am not familiar with ASA but unless you configure them to export templates, there's no way for nprobe to parse their netflow. Can you check this?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/ntop/ntopng/issues/4910*issuecomment-766962399__;Iw!!C6sPl7C9qQ!Ebs0-qSq0Iq1UVfezwFCRahUPMtURcWQQxkayUdN6GlNW31n0srof7_C28-OcEhAjzY$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/AH7JEH3T2Z7V2C2MLVPHKODS3WQA7ANCNFSM4WCAOI6Q__;!!C6sPl7C9qQ!Ebs0-qSq0Iq1UVfezwFCRahUPMtURcWQQxkayUdN6GlNW31n0srof7_C28-OT7Gs0hE$.
This message is for the recipient’s use only, and may contain confidential, privileged or protected information. Any unauthorized use or dissemination of this communication is prohibited. If you received this message in error, please immediately notify the sender and destroy all copies of this message. The recipient should check this email and any attachments for the presence of viruses, as we accept no liability for any damage caused by any virus transmitted by this email.
Someone is already using that port.
27/Jan/2021 08:41:05 [util.c:5102] ERROR: Unable to bind ZMQ endpoint tcp://*:5556: Address already in use
Check with net stat, kill the process using it, and restart.
Ok was able to resolve that issue. Killed the process.
Was able to also resolve the ASA Netflow issue by adding -n with the target address ( ntopng:5556)
--online-license-check -i=none -n=10.1.28.70:5556 --zmq="tcp://*:5556" -3=2055
From: Simone Mainardi notifications@github.com Reply-To: ntop/ntopng reply@reply.github.com Date: Wednesday, January 27, 2021 at 9:34 AM To: ntop/ntopng ntopng@noreply.github.com Cc: Justin Maldonado jmaldonado@NYGENOME.ORG, Author author@noreply.github.com Subject: Re: [ntop/ntopng] Have 2 ASA's with identical configs; only 1 ASA appears in NTOP (#4910)
Someone is already using that port.
27/Jan/2021 08:41:05 [util.c:5102] ERROR: Unable to bind ZMQ endpoint tcp://*:5556: Address already in use
Check with net stat, kill the process using it, and restart.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/ntop/ntopng/issues/4910*issuecomment-768326480__;Iw!!C6sPl7C9qQ!F7Xua1IziQS5eenCHqCLuI_h_d4MBKT3NyzhTWBO0kHA8zECpPXpMTMnXkfr2rCiUnk$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/AH7JEH7ZTXKRF7OAMKLUTP3S4AQATANCNFSM4WCAOI6Q__;!!C6sPl7C9qQ!F7Xua1IziQS5eenCHqCLuI_h_d4MBKT3NyzhTWBO0kHA8zECpPXpMTMnXkfrOV7wiq4$.
This message is for the recipient’s use only, and may contain confidential, privileged or protected information. Any unauthorized use or dissemination of this communication is prohibited. If you received this message in error, please immediately notify the sender and destroy all copies of this message. The recipient should check this email and any attachments for the presence of viruses, as we accept no liability for any damage caused by any virus transmitted by this email.
I can see packets making it to nprobe, NTOP sees ASA from SNMP perspective, flow data for ASA is not making it from nprobe over to ntop. Any idea what this could be?
Some logs....not sure if the unresponsive has anything to do with it.