VxLan tunnel information is not shown properly while configuring EVPN (tunnel destination remains blank)

kamalsahu0001 commented 2 years ago

Configure BGP EVPN VxLAN using two L2VNI The host routes are advertised and learned properly. In the configuration, 2 vlans 30 and 40 are added and L2VNI's configured as 3000 and 4000 while verifying the configuration using "show bgp l2vpn evpn", the routes are learned. If we use "show vxlan tunnel", it doesn't show the destination ip address and also all the vni-vlan mappings are not shown

sonic# show bgp l2vpn evpn BGP table version is 7, local router ID is 192.168.4.254 Status codes: s suppressed, d damped, h history, * valid, > best, i - internal Origin codes: i - IGP, e - EGP, ? - incomplete EVPN type-1 prefix: [1]:[ESI]:[EthTag]:[IPlen]:[VTEP-IP] EVPN type-2 prefix: [2]:[EthTag]:[MAClen]:[MAC]:[IPlen]:[IP] EVPN type-3 prefix: [3]:[EthTag]:[IPlen]:[OrigIP] EVPN type-4 prefix: [4]:[ESI]:[IPlen]:[OrigIP] EVPN type-5 prefix: [5]:[EthTag]:[IPlen]:[IP]

Network Next Hop Metric LocPrf Weight Path Route Distinguisher: 2.2.2.2:1 >i[2]:[0]:[48]:[22:22:00:00:00:01]:[32]:[192.168.3.2] 2.2.2.2 0 0 i RT:65100:3000 ET:8 Rmac:10:10:10:00:00:01 Route Distinguisher: 2.2.2.2:2 >i[2]:[0]:[48]:[22:22:00:00:00:02]:[32]:[192.168.4.2] 2.2.2.2 0 0 i RT:65100:4000 ET:8 Rmac:10:10:10:00:00:01 Route Distinguisher: 192.168.4.254:2 > [2]:[0]:[48]:[44:44:00:00:00:01] 1.1.1.1 32768 i ET:8 RT:65100:3000 MM:2 > [2]:[0]:[48]:[44:44:00:00:00:01]:[32]:[192.168.3.1] 1.1.1.1 32768 i ET:8 RT:65100:3000 MM:2 > [3]:[0]:[32]:[1.1.1.1] 1.1.1.1 32768 i ET:8 RT:65100:3000 Route Distinguisher: 192.168.4.254:3 > [2]:[0]:[48]:[44:44:00:00:01:01] 1.1.1.1 32768 i ET:8 RT:65100:4000 > [2]:[0]:[48]:[44:44:00:00:01:01]:[32]:[192.168.4.1] 1.1.1.1 32768 i ET:8 RT:65100:4000 > [3]:[0]:[32]:[1.1.1.1] 1.1.1.1 32768 i ET:8 RT:65100:4000

Displayed 8 out of 8 total prefixes

admin@sonic:~$ show vxlan tunnel vxlan tunnel name source ip destination ip tunnel map name tunnel map mapping(vni -> vlan)

vtep 1.1.1.1 map_4000_Vlan40 4000 -> Vlan40

admin@sonic:~$ show vxlan vlanvnimap +--------+-------+ | VLAN | VNI | +========+=======+ | Vlan30 | 3000 | +--------+-------+ | Vlan40 | 4000 | +--------+-------+ Total count : 2

Vxlan configuration:

"VLAN": { "Vlan30": { "vlanid": "30" }, "Vlan40": { "vlanid": "40" } }, "VLAN_INTERFACE": { "Vlan30": {}, "Vlan40": {}, "Vlan30|192.168.3.254/24": {}, "Vlan40|192.168.4.254/24": {} }, "VLAN_MEMBER": { "Vlan30|Ethernet12": { "tagging_mode": "tagged" }, "Vlan40|Ethernet12": { "tagging_mode": "tagged" } }, "VXLAN_EVPN_NVO": { "nvo": { "source_vtep": "vtep" } }, "VXLAN_TUNNEL": { "vtep": { "src_ip": "1.1.1.1" } }, "VXLAN_TUNNEL_MAP": { "vtep|map_3000_Vlan30": { "vlan": "Vlan30", "vni": "3000" }, "vtep|map_4000_Vlan40": { "vlan": "Vlan40", "vni": "4000" } },

prsunny commented 2 years ago

@srj102, could you please take a look?

srj102 commented 2 years ago

@kamalsahu0001 Could you check show vxlan remotevtep ?

There is a mismatch between the HLD and the actual implementation.

kamalsahu0001 commented 2 years ago

It shows blank.

srj102 commented 2 years ago

Please also share outputs of

show vxlan remotevni all
show vxlan remotemac all
ifconfig Vlan30 --> Is the Vlan30 operup? Can you add a member to the VLAN and bring the interface up ?
ifconfig Vlan40 --> Is the Vlan40 operup ?

srj102 commented 2 years ago

Please share fdbsyncd, orchagent logs.

kamalsahu0001 commented 2 years ago

admin@sonic:~$ show vxlan remotevni all +--------+--------------+-------+ | VLAN | RemoteVTEP | VNI | +========+==============+=======+ +--------+--------------+-------+ Total count : 0

admin@sonic:~$ show vxlan remotemac all +--------+-------------------+--------------+-------+---------+ | VLAN | MAC | RemoteVTEP | VNI | Type | +========+===================+==============+=======+=========+ | Vlan30 | 22:22:00:00:00:01 | 2.2.2.2 | 3000 | dynamic | +--------+-------------------+--------------+-------+---------+ | Vlan40 | 22:22:00:00:00:02 | 2.2.2.2 | 4000 | dynamic | +--------+-------------------+--------------+-------+---------+ Total count : 2

admin@sonic:~$ show int status Interface Lanes Speed MTU FEC Alias Vlan Oper Admin Type Asym PFC

Ethernet0 0,1,2,3 100G 9100 rs Ethernet0 routed down up N/A N/A Ethernet4 4,5,6,7 100G 9100 rs Ethernet4 routed down up N/A N/A Ethernet8 8,9,10,11 100G 9100 rs Ethernet8 routed up up QSFP28 or later N/A Ethernet12 12,13,14,15 100G 9100 rs Ethernet12 trunk up up QSFP28 or later N/A Ethernet16 16,17,18,19 100G 9100 rs Ethernet16 routed up up QSFP28 or later N/A Ethernet20 20,21,22,23 100G 9100 rs Ethernet20 routed up up QSFP28 or later N/A

admin@sonic:~$ show vlan brief +-----------+------------------+------------+----------------+-------------+-----------------------+	VLAN ID	IP Address	Ports	Port Tagging	Proxy ARP	DHCP Helper Address	+===========+==================+============+================+=============+=======================+	30	192.168.3.254/24	Ethernet12	tagged	disabled		+-----------+------------------+------------+----------------+-------------+-----------------------+	40	192.168.4.254/24	Ethernet12	tagged	disabled		+-----------+------------------+------------+----------------+-------------+-----------------------+ admin@sonic:~$ show ip int Interface Master IPv4 address/mask Admin/Oper BGP Neighbor Neighbor IP

Ethernet0 10.0.0.0/31 up/down ARISTA01T2 10.0.0.1 Ethernet4 10.0.0.2/31 up/down ARISTA02T2 10.0.0.3 Ethernet8 20.0.0.1/24 up/up N/A N/A Ethernet16 10.0.0.8/31 up/up ARISTA05T2 10.0.0.9 Ethernet20 10.0.0.10/31 up/up ARISTA06T2 10.0.0.11 Loopback0 1.1.1.1/32 up/up N/A N/A Vlan30 192.168.3.254/24 up/up N/A N/A Vlan40 192.168.4.254/24 up/up N/A N/A docker0 240.127.1.1/24 up/down N/A N/A eth0 10.36.79.174/22 up/up N/A N/A lo 127.0.0.1/16 up/up N/A N/A admin@sonic:~$

sonic_dump_sonic_20211026_001932.tar.gz

srj102 commented 2 years ago

Hi, Since there are no IMR routes we don't see tunnels. There is an assumption/requirement that we need IMR routes in addition to MAC routes.

kamalsahu0001 commented 2 years ago

Hi @srj102

Even after advertising IMR route, still don't see vxlan tunnel destination IP. Currently using only single L2 VNI

sonic# show bgp l2vpn evpn BGP table version is 12, local router ID is 192.168.3.254 Status codes: s suppressed, d damped, h history, * valid, > best, i - internal Origin codes: i - IGP, e - EGP, ? - incomplete EVPN type-1 prefix: [1]:[ESI]:[EthTag]:[IPlen]:[VTEP-IP] EVPN type-2 prefix: [2]:[EthTag]:[MAClen]:[MAC]:[IPlen]:[IP] EVPN type-3 prefix: [3]:[EthTag]:[IPlen]:[OrigIP] EVPN type-4 prefix: [4]:[ESI]:[IPlen]:[OrigIP] EVPN type-5 prefix: [5]:[EthTag]:[IPlen]:[IP]

Network Next Hop Metric LocPrf Weight Path Route Distinguisher: 2.2.2.2:1 >i[2]:[0]:[48]:[22:22:00:00:00:01]:[32]:[192.168.3.2] 2.2.2.2 0 0 i RT:65100:3000 ET:8 Rmac:10:10:10:00:00:01 >i[3]:[0]:[32]:[2.2.2.2] 2.2.2.2 0 0 i RT:65100:3000 ET:8 Route Distinguisher: 192.168.3.254:2 > [2]:[0]:[48]:[44:44:00:00:00:01] 1.1.1.1 32768 i ET:8 RT:65100:3000 > [2]:[0]:[48]:[44:44:00:00:00:01]:[32]:[192.168.3.1] 1.1.1.1 32768 i ET:8 RT:65100:3000 *> [3]:[0]:[32]:[1.1.1.1] 1.1.1.1 32768 i ET:8 RT:65100:3000

Displayed 5 out of 5 total prefixes sonic# sonic# sonic# sonic# exit admin@sonic:~$ show vxlan tunnel vxlan tunnel name source ip destination ip tunnel map name tunnel map mapping(vni -> vlan)

vtep 1.1.1.1 map_3000_Vlan30 3000 -> Vlan30 admin@sonic:~$

srj102 commented 2 years ago

@kishorekunal01 can you check this ?

show vxlan remotevni reads from the VXLAN_REMOTE_VNI table of the APP DB. This seems empty and hence the show vxlan remotevtep does not show any tunnels.

kishorekunal01 commented 2 years ago

This looks like some issue with FRR. There is no entry for 00:00:00:00:00:00 for the given vlan in the bridge.fdb file. This entry represent the imet route in the kernel.

Check your FRR cli if the vlan is extended in the FRR. "show evpn vni "

kamalsahu0001 commented 2 years ago

sonic# show evpn vni 3000 VNI: 3000 Type: L2 Tenant VRF: default VxLAN interface: vtep-30 VxLAN ifIndex: 376 Local VTEP IP: 1.1.1.1 Mcast group: 0.0.0.0 Remote VTEPs for this VNI: 2.2.2.2 flood: HER Number of MACs (local and remote) known for this VNI: 2 Number of ARPs (IPv4 and IPv6, local and remote) known for this VNI: 2 Advertise-gw-macip: No Advertise-svi-macip: No

kishorekunal01 commented 2 years ago

Please check "bridge fdb show" on linux. It should show entries like below.

00:00:00:00:00:00 dev vtep-leaf-295 dst 3.3.3.3 self permanent 00:00:00:00:00:00 dev vtep-leaf-295 dst 45.45.45.45 self permanent 00:00:00:00:00:00 dev vtep-leaf-295 dst 6.6.6.6 self permanent

Else there is some issue with ip stack, somehow it is rejecting these imet routes.

On Tue, Nov 2, 2021 at 11:59 AM kamalsahu0001 @.***> wrote:

sonic# show evpn vni 3000 VNI: 3000 Type: L2 Tenant VRF: default VxLAN interface: vtep-30 VxLAN ifIndex: 376 Local VTEP IP: 1.1.1.1 Mcast group: 0.0.0.0 Remote VTEPs for this VNI: 2.2.2.2 flood: HER Number of MACs (local and remote) known for this VNI: 2 Number of ARPs (IPv4 and IPv6, local and remote) known for this VNI: 2 Advertise-gw-macip: No Advertise-svi-macip: No

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Azure/sonic-buildimage/issues/9028#issuecomment-958069171, or unsubscribe https://github.com/notifications/unsubscribe-auth/APIREPFFQ7M6TW3F26JDOODUKA7JZANCNFSM5GNJLRTA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

-- This electronic communication and the information and any files transmitted with it, or attached to it, are confidential and are intended solely for the use of the individual or entity to whom it is addressed and may contain information that is confidential, legally privileged, protected by privacy laws, or otherwise restricted from disclosure to anyone else. If you are not the intended recipient or the person responsible for delivering the e-mail to the intended recipient, you are hereby notified that any use, copying, distributing, dissemination, forwarding, printing, or copying of this e-mail is strictly prohibited. If you received this e-mail in error, please return the e-mail to the sender, delete it from your computer, and destroy any printed copy of it.

kamalsahu0001 commented 2 years ago

I can see it:

admin@sonic:~$ sudo bridge fdb show | grep 30 a8:2b:b5:87:a0:dc dev Bridge vlan 30 master Bridge permanent 01:00:5e:00:00:01 dev Vlan30 self permanent 33:33:00:00:00:02 dev Vlan30 self permanent 33:33:00:00:00:01 dev Vlan30 self permanent 33:33:ff:87:a0:dc dev Vlan30 self permanent 33:33:ff:00:00:00 dev Vlan30 self permanent 22:22:00:00:00:01 dev vtep-30 vlan 30 extern_learn master Bridge 00:00:00:00:00:00 dev vtep-30 dst 2.2.2.2 self permanent 22:22:00:00:00:01 dev vtep-30 dst 2.2.2.2 self extern_learn

kamalsahu0001 commented 2 years ago

Also issue observed with not on single platform. It can be seen on different platforms, between two DUTs or using Emulator

kishorekunal01 commented 2 years ago

Please enable log(SWSS_LOG_INFO) for fdbsyncd and delete/add the vni again so that event can be again triggered.

Please collect TS and load it to the defect.

On Tue, Nov 2, 2021 at 12:28 PM kamalsahu0001 @.***> wrote:

Also issue observed with not on single platform. It can be seen on different platforms, between two DUTs or using Emulator

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Azure/sonic-buildimage/issues/9028#issuecomment-958101419, or unsubscribe https://github.com/notifications/unsubscribe-auth/APIREPENKUT6VYPOF6QHBWLUKBCVVANCNFSM5GNJLRTA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

-- This electronic communication and the information and any files transmitted with it, or attached to it, are confidential and are intended solely for the use of the individual or entity to whom it is addressed and may contain information that is confidential, legally privileged, protected by privacy laws, or otherwise restricted from disclosure to anyone else. If you are not the intended recipient or the person responsible for delivering the e-mail to the intended recipient, you are hereby notified that any use, copying, distributing, dissemination, forwarding, printing, or copying of this e-mail is strictly prohibited. If you received this e-mail in error, please return the e-mail to the sender, delete it from your computer, and destroy any printed copy of it.

kamalsahu0001 commented 2 years ago

Can you please provide me with the command to enable the log?

srj102 commented 2 years ago

swssloglevel -l INFO -c fdbsyncd

swssloglevel -p

swssloglevel -h

kamalsahu0001 commented 2 years ago

sonic_dump_sonic_20211104_061028.tar.gz

kishorekunal01 commented 2 years ago

I am not sure what is going wrong here.

Earlier your pasted: @.**:~$ sudo bridge fdb show | grep 30 a8:2b:b5:87:a0:dc dev Bridge vlan 30 master Bridge permanent 01:00:5e:00:00:01 dev Vlan30 self permanent 33:33:00:00:00:02 dev Vlan30 self permanent 33:33:00:00:00:01 dev Vlan30 self permanent 33:33:ff:87:a0:dc dev Vlan30 self permanent 33:33:ff:00:00:00 dev Vlan30 self permanent 22:22:00:00:00:01 dev vtep-30 vlan 30 extern_learn master Bridge 00:00:00:00:00:00 dev vtep-30 dst 2.2.2.2 self permanent* 22:22:00:00:00:01 dev vtep-30 dst 2.2.2.2 self extern_learn

Whereas the Latest TS you provided doesn't have this entry in the bridge fdb table. sonic_dump_sonic_20211104_061028/dump/bridge.fdb This doesn't have any mac with 00:00:00:00:00:00 (IMET route missing)

Logs from the fdbsyncd after the reboot syslog.1.gz:Nov 4 06:07:38.911834 sonic INFO swss#supervisord 2021-11-04 06:07:38,911 INFO stopped: fdbsyncd (terminated by SIGTERM) syslog.1.gz:Nov 4 06:09:03.347058 sonic INFO swss#supervisord 2021-11-04 06:09:03,329 INFO spawned: 'fdbsyncd' with pid 171 syslog.1.gz:Nov 4 06:09:03.422438 sonic NOTICE swss#fdbsyncd: :- setWarmStartState: fdbsyncd warm start state changed to disabled syslog.1.gz:Nov 4 06:09:03.422916 sonic NOTICE swss#fdbsyncd: :- main: Listens to link and neigh messages... syslog.1.gz:Nov 4 06:09:03.428538 sonic INFO swss#fdbsyncd: :- onMsgLink: Op:16 VxLAN dev vtep-30 index:43 vni:3000 syslog.1.gz:Nov 4 06:09:03.453670 sonic INFO swss#fdbsyncd: :- loadRedisScript: lua script redis.replicate_commands()#012local ret = {}#012local tablename = KEYS[2]#012local stateprefix = ARGV[2]#012local keys = redis.call('SPOP', KEYS[1], ARGV[1])#012local n = table.getn(keys)#012for i = 1, n do#012 local key = keys[i]#012 -- Check if there was request to delete the key, clear it in table first#012 local num = redis.call('SREM', KEYS[3], key)#012 if num == 1 then#012 redis.call('DEL', tablename..key)#012 end#012 -- Push the new set of field/value for this key in table#012 local fieldvalues = redis.call('HGETALL', stateprefix..tablename..key)#012 table.insert(ret, {key, fieldvalues})#012 for i = 1, #fieldvalues, 2 do#012 redis.call('HSET', tablename..key, fieldvalues[i], fieldvalues[i + 1])#012 end#012 -- Clean up the key in temporary state table#012 redis.call('DEL', stateprefix..tablename..key)#012end#012return ret#012 loaded, sha: 88270a7c5c90583e56425aca8af8a4b8c39fe757 syslog.1.gz:Nov 4 06:09:03.517432 sonic INFO swss#fdbsyncd: :- updateMclagRemoteMacPort: Updating Intf 76, Vlan:-1 MAC:44:4c:a8:ca:41:94 Key Vlan-1:44:4c:a8:ca:41:94 syslog.1.gz:Nov 4 06:09:03.517565 sonic INFO swss#fdbsyncd: :- macRefreshStateDB: Refreshing Vlan:1 MAC route MAC:f6:18:2d:09:fe:35 Key Vlan1:f6:18:2d:09:fe:35 syslog.1.gz:Nov 4 06:09:03.517631 sonic INFO swss#fdbsyncd: :- updateMclagRemoteMacPort: Updating Intf 76, Vlan:1 MAC:44:4c:a8:ca:41:94 Key Vlan1:44:4c:a8:ca:41:94 syslog.1.gz:Nov 4 06:09:03.587327 sonic INFO swss#fdbsyncd: :- onMsgLink: Op:16 VxLAN dev vtep-30 index:43 vni:3000 syslog.1.gz:Nov 4 06:09:03.599339 sonic INFO swss#fdbsyncd: :- macRefreshStateDB: Refreshing Vlan:1 MAC route MAC:44:4c:a8:ca:41:94 Key Vlan1:44:4c:a8:ca:41:94 syslog.1.gz:Nov 4 06:09:03.683868 sonic INFO swss#fdbsyncd: :- updateMclagRemoteMacPort: Updating Intf 77, Vlan:-1 MAC:46:63:aa:14:1b:2d Key Vlan-1:46:63:aa:14:1b:2d syslog.1.gz:Nov 4 06:09:03.687759 sonic INFO swss#fdbsyncd: :- updateMclagRemoteMacPort: Updating Intf 77, Vlan:1 MAC:46:63:aa:14:1b:2d Key Vlan1:46:63:aa:14:1b:2d syslog.1.gz:Nov 4 06:09:03.753217 sonic INFO swss#fdbsyncd: :- updateMclagRemoteMacPort: Updating Intf 76, Vlan:20 MAC:44:4c:a8:ca:41:94 Key Vlan20:44:4c:a8:ca:41:94 syslog.1.gz:Nov 4 06:09:03.842761 sonic INFO swss#fdbsyncd: :- updateMclagRemoteMacPort: Updating Intf 76, Vlan:30 MAC:44:4c:a8:ca:41:94 Key Vlan30:44:4c:a8:ca:41:94 syslog.1.gz:Nov 4 06:09:03.978518 sonic INFO swss#fdbsyncd: :- updateMclagRemoteMacPort: Updating Intf 55, Vlan:1 MAC:44:4c:a8:ca:41:94 Key Vlan1:44:4c:a8:ca:41:94 syslog.1.gz:Nov 4 06:09:04.026055 sonic INFO swss#fdbsyncd: :- macRefreshStateDB: Refreshing Vlan:1 MAC route MAC:44:4c:a8:ca:41:94 Key Vlan1:44:4c:a8:ca:41:94 syslog.1.gz:Nov 4 06:09:04.087778 sonic INFO swss#fdbsyncd: :- updateMclagRemoteMacPort: Updating Intf 53, Vlan:1 MAC:44:4c:a8:ca:41:94 Key Vlan1:44:4c:a8:ca:41:94 syslog.1.gz:Nov 4 06:09:04.136808 sonic INFO swss#fdbsyncd: :- macRefreshStateDB: Refreshing Vlan:1 MAC route MAC:44:4c:a8:ca:41:94 Key Vlan1:44:4c:a8:ca:41:94 syslog.1.gz:Nov 4 06:09:04.320513 sonic INFO swss#supervisord 2021-11-04 06:09:04,319 INFO success: fdbsyncd entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) syslog.1.gz:Nov 4 06:09:07.528121 sonic INFO swss#fdbsyncd: :- processStateFdb: FDBSYNCD STATE FDB updates key=Vlan30:44:44:00:00:00:01, operation=SET syslog.1.gz:Nov 4 06:09:07.528282 sonic INFO swss#fdbsyncd: :- processStateFdb: FDBSYNCD STATE FDB updates : FvFiels port, FvValues: Ethernet4 syslog.1.gz:Nov 4 06:09:07.528352 sonic INFO swss#fdbsyncd: :- processStateFdb: FDBSYNCD STATE FDB updates : FvFiels type, FvValues: dynamic syslog.1.gz:Nov 4 06:09:07.532603 sonic INFO swss#fdbsyncd: :- updateLocalMac: cmd: bridge fdb replace 44:44:00:00:00:01 dev Ethernet4 master dynamic vlan 30, res=, ret=0

But I can see that the IMET route was added once before this reboot from the logs. syslog.1.gz:Nov 4 06:07:35.981431 sonic INFO swss#fdbsyncd: :- onMsgNbr: Tunnel IP 2.2.2.2 Int33686018

syslog.1.gz:Nov 4 06:07:35.981501 sonic INFO swss#fdbsyncd: :- macAddVxlan: VXLAN_FDB_TABLE: ADD_KEY Vlan30:22:22:00:00:00:01 vtep:2.2.2.2 type:dynamicsyslog.1.gz:Nov 4 06:07:35.981892 sonic INFO swss#fdbsyncd: :- onMsgNbr: Tunnel IP 2.2.2.2 Int33686018 syslog.1.gz:Nov 4 06:07:35.981892 sonic INFO swss#fdbsyncd: :- imetAddRoute: IMET Add route key:Vlan30:2.2.2.2 vtep:2.2.2.2 Vlan30

Thanks, Kishore Kunal

On Wed, Nov 3, 2021 at 11:46 PM kamalsahu0001 @.***> wrote:

sonic_dump_sonic_20211104_061028.tar.gz https://github.com/Azure/sonic-buildimage/files/7472800/sonic_dump_sonic_20211104_061028.tar.gz

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Azure/sonic-buildimage/issues/9028#issuecomment-960498065, or unsubscribe https://github.com/notifications/unsubscribe-auth/APIREPAO7XZYL55QJEIDAZLUKI24JANCNFSM5GNJLRTA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

-- This electronic communication and the information and any files transmitted with it, or attached to it, are confidential and are intended solely for the use of the individual or entity to whom it is addressed and may contain information that is confidential, legally privileged, protected by privacy laws, or otherwise restricted from disclosure to anyone else. If you are not the intended recipient or the person responsible for delivering the e-mail to the intended recipient, you are hereby notified that any use, copying, distributing, dissemination, forwarding, printing, or copying of this e-mail is strictly prohibited. If you received this e-mail in error, please return the e-mail to the sender, delete it from your computer, and destroy any printed copy of it.

kamalsahu0001 commented 2 years ago

The latest logs were attached from another switch with different platform. Let me add the logs from the same switch which i tested before.

kamalsahu0001 commented 2 years ago

dump.zip log.zip proc.zip sai.zip warmboot.zip

kamalsahu0001 commented 2 years ago

logs from another switch. sonic_dump_sonic_20211108_051740.tar.gz

kishorekunal01 commented 2 years ago

I checked Tech support (sonic_dump_sonic_20211108_051740.tar.gz)

bridge.fdb there is no imet route (00:00:00:00:00:00) . In fact I don't see any vxlan interface in the ip.link file.

timeout --foreground 5m bridge fdb show 01:00:5e:00:00:01 dev eth0 self permanent 33:33:00:00:00:01 dev eth0 self permanent 33:33:ff:65:d6:d0 dev eth0 self permanent 33:33:ff:04:86:41 dev eth0 self permanent 01:80:c2:00:00:0e dev eth0 self permanent 01:80:c2:00:00:03 dev eth0 self permanent 01:80:c2:00:00:00 dev eth0 self permanent 33:33:00:00:00:01 dev docker0 self permanent 33:33:00:00:00:02 dev docker0 self permanent 33:33:ff:00:00:01 dev docker0 self permanent 33:33:ff:00:00:00 dev docker0 self permanent 01:00:5e:00:00:01 dev docker0 self permanent 02:42:fd:33:d9:ee dev docker0 vlan 1 master docker0 permanent 02:42:fd:33:d9:ee dev docker0 master docker0 permanent 33:33:00:00:00:01 dev usb0 self permanent 33:33:00:00:00:02 dev usb0 self permanent 01:00:5e:00:00:01 dev usb0 self permanent 33:33:ff:00:00:02 dev usb0 self permanent 33:33:ff:00:00:00 dev usb0 self permanent 33:33:00:00:00:01 dev Bridge self permanent 33:33:00:00:00:02 dev Bridge self permanent 01:00:5e:00:00:01 dev Bridge self permanent 33:33:ff:95:cf:4c dev Bridge self permanent 33:33:ff:00:00:00 dev Bridge self permanent 01:80:c2:00:00:21 dev Bridge self permanent 00:90:fb:65:d6:d0 dev Bridge vlan 30 master Bridge permanent 00:90:fb:65:d6:d0 dev Bridge master Bridge permanent 33:33:00:00:00:01 dev Loopback0 self permanent 01:00:5e:00:00:01 dev Loopback0 self permanent ce:f9:e0:55:e0:df dev dummy vlan 1 master Bridge permanent ce:f9:e0:55:e0:df dev dummy master Bridge permanent 33:33:00:00:00:01 dev dummy self permanent 33:33:00:00:00:01 dev Vlan30 self permanent 33:33:00:00:00:02 dev Vlan30 self permanent 01:00:5e:00:00:01 dev Vlan30 self permanent

Thanks, Kishore Kunal

On Wed, Nov 10, 2021 at 7:30 PM kamalsahu0001 @.***> wrote:

logs from another switch. sonic_dump_sonic_20211108_051740.tar.gz https://github.com/Azure/sonic-buildimage/files/7517515/sonic_dump_sonic_20211108_051740.tar.gz

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Azure/sonic-buildimage/issues/9028#issuecomment-965957254, or unsubscribe https://github.com/notifications/unsubscribe-auth/APIREPAKFDOOM3SDHMB5LALULM2EDANCNFSM5GNJLRTA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

-- This electronic communication and the information and any files transmitted with it, or attached to it, are confidential and are intended solely for the use of the individual or entity to whom it is addressed and may contain information that is confidential, legally privileged, protected by privacy laws, or otherwise restricted from disclosure to anyone else. If you are not the intended recipient or the person responsible for delivering the e-mail to the intended recipient, you are hereby notified that any use, copying, distributing, dissemination, forwarding, printing, or copying of this e-mail is strictly prohibited. If you received this e-mail in error, please return the e-mail to the sender, delete it from your computer, and destroy any printed copy of it.

kamalsahu0001 commented 2 years ago

@kishorekunal01 .. Can you please check the logs from other switch. When i am advertising IMET route, then some crash is happening inside and the routes are getting disappeared. This is seen in sonic_dump_sonic_20211108_051740.tar.gz

Without advertising IMET routes, it remains stable.

kamalsahu0001 commented 2 years ago

I am not able to add the techsupport zip file from other switch as it is giving "is not included the list" error. So i removed the folder which was giving that error and added separate folders for each of them.

I have the zip file. If there is any other location where I can attach it, I will add it there.

kishorekunal01 commented 2 years ago

@srj102 The dump shared by @kamalsahu0001 (dump.zip Nov10, 2021) Has IMET route and it is updated to APP_DB. Can you please check why show vxlan remotevtep does not show tunnels information.

bridge.fdb 22:22:00:00:00:01 dev vtep-30 vlan 30 extern_learn master Bridge 00:00:00:00:00:00 dev vtep-30 dst 2.2.2.2 self permanent 22:22:00:00:00:01 dev vtep-30 dst 2.2.2.2 self extern_learn

APP_DB "VXLAN_FDB_TABLE:Vlan30:22:22:00:00:00:01": { "expireat": 1636240474.599899, "ttl": -0.001, "type": "hash", "value": { "remote_vtep": "2.2.2.2", "type": "dynamic", "vni": "3000" } }, "VXLAN_REMOTE_VNI_TABLE:Vlan30:2.2.2.2": { "expireat": 1636240474.599806, "ttl": -0.001, "type": "hash", "value": { "vni": "3000" } },

prsunny commented 2 years ago

@srj102 , @kishorekunal01 , could you please help move this forward

kamalsahu0001 commented 2 years ago

@srj102 , @kishorekunal01 .. any update here ?

srj102 commented 2 years ago

Same issue as https://github.com/Azure/sonic-buildimage/issues/9694

kamalsahu0001 commented 2 years ago

Attached the logs from broadcom chipset sonic_dump_sonic_20210721_222140.tar.gz

srj102 commented 2 years ago

}()@: dump $ grep VXLAN APPL_DB.json "VXLAN_EVPN_NVO_TABLE:nvo": { "VXLAN_TUNNEL_MAP_TABLE:vtep:map_101_Vlan101": { "VXLAN_TUNNEL_MAP_TABLE:vtep:map_102_Vlan102": { "VXLAN_TUNNEL_MAP_TABLE:vtep:map_103_Vlan103": { "VXLAN_TUNNEL_TABLE:vtep": {

()@: dump $ grep vtep ip.link 45: vtep-101: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master Bridge state UNKNOWN mode DEFAULT group default qlen 1000 46: vtep-102: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master Bridge state UNKNOWN mode DEFAULT group default qlen 1000 47: vtep-103: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master Bridge state UNKNOWN mode DEFAULT group default qlen 1000

grep Vlan ip.link 42: Vlan101@Bridge: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9100 qdisc noqueue state UP mode DEFAULT group default qlen 1000 43: Vlan102@Bridge: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9100 qdisc noqueue state UP mode DEFAULT group default qlen 1000 44: Vlan103@Bridge: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9100 qdisc noqueue state UP mode DEFAULT group default qlen 1000

dummy 1 PVID Egress Untagged

vtep-101 101 PVID Egress Untagged

vtep-102 102 PVID Egress Untagged

vtep-103 103 PVID Egress Untagged

@kishorekunal01 Can you check the latest logs attached for AS7726 on why the fdbsyncd did not populate the APP DB tables. Cant see ROUTE_TABLE/VXLAN_REMOTE_VNI/VXLAN_FDB populated.

Separately there are SAI config file issues in this chassis. @prsunny @kamalsahu0001 This chassis does not seem to have the sai config file for EVPN support leading to a lot of SAI errors. Could you please check on that ?

kishorekunal01 commented 2 years ago

@kamalsahu0001 https://github.com/kamalsahu0001 ROUTE_TABLE/VXLAN_REMOTE_VNI/VXLAN_FDB is not populated since it looks like there is no EVPN route received from the BGP neighbor.

If you expect to receive a route from the BGP neighbor. Please collect below information from the FRR. show bgp l2vpn evpn summary show bgp l2vpn evpn route detail show bgp l2vpn evpn route vni all detail show bgp l2vpn evpn vni show evpn vni detail show evpn arp-cache vni all detail show evpn mac vni all detail show evpn rmac vni all

And please provide both the node Techsupport with above information in the failed state. We need to see the route origination and route received in BGP.

@prsunny https://github.com/prsunny Is it possible to collect below information as part of TS from vtysh.

save_vtysh "show bgp l2vpn evpn summary" "bgp.evpn.summary" save_vtysh "show bgp l2vpn evpn route detail" "bgp.evpn.routes" save_vtysh "show bgp l2vpn evpn route vni all detail" "bgp.evpn.vpn.routes" save_vtysh "show bgp l2vpn evpn vni" "bgp.evpn.vni" save_vtysh "show evpn vni detail" "frr.evpn.vni.detail" save_vtysh "show evpn arp-cache vni all detail" "frr.evpn.arp_cache.all" save_vtysh "show evpn mac vni all detail" "frr.evpn.mac.all" save_vtysh "show evpn rmac vni all" "frr.evpn.rmac.all"

Thanks and Regards, Kishore Kunal

On Fri, Jan 28, 2022 at 4:30 AM Rajesh Sankaran @.***> wrote:

}()@: dump $ grep VXLAN APPL_DB.json "VXLAN_EVPN_NVO_TABLE:nvo": { "VXLAN_TUNNEL_MAP_TABLE:vtep:map_101_Vlan101": { "VXLAN_TUNNEL_MAP_TABLE:vtep:map_102_Vlan102": { "VXLAN_TUNNEL_MAP_TABLE:vtep:map_103_Vlan103": { "VXLAN_TUNNEL_TABLE:vtep": {

()@: dump $ grep vtep ip.link 45: vtep-101: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master Bridge state UNKNOWN mode DEFAULT group default qlen 1000 46: vtep-102: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master Bridge state UNKNOWN mode DEFAULT group default qlen 1000 47: vtep-103: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master Bridge state UNKNOWN mode DEFAULT group default qlen 1000

grep Vlan ip.link 42: @.: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9100 qdisc noqueue state UP mode DEFAULT group default qlen 1000 43: @.: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9100 qdisc noqueue state UP mode DEFAULT group default qlen 1000 44: @.***: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9100 qdisc noqueue state UP mode DEFAULT group default qlen 1000

dummy 1 PVID Egress Untagged

vtep-101 101 PVID Egress Untagged

vtep-102 102 PVID Egress Untagged

vtep-103 103 PVID Egress Untagged

@kishorekunal01 https://github.com/kishorekunal01 Can you check the latest logs attached for AS7726 on why the fdbsyncd did not populate the APP DB tables. Cant see ROUTE_TABLE/VXLAN_REMOTE_VNI/VXLAN_FDB populated.

Separately there are SAI config file issues in this chassis. @prsunny https://github.com/prsunny @kamalsahu0001 https://github.com/kamalsahu0001 This chassis does not seem to have the sai config file for EVPN support leading to a lot of SAI errors. Could you please check on that ?

— Reply to this email directly, view it on GitHub https://github.com/Azure/sonic-buildimage/issues/9028#issuecomment-1024170461, or unsubscribe https://github.com/notifications/unsubscribe-auth/APIREPDEYNJ76J4M7DXEHA3UYKD7TANCNFSM5GNJLRTA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

-- This electronic communication and the information and any files transmitted with it, or attached to it, are confidential and are intended solely for the use of the individual or entity to whom it is addressed and may contain information that is confidential, legally privileged, protected by privacy laws, or otherwise restricted from disclosure to anyone else. If you are not the intended recipient or the person responsible for delivering the e-mail to the intended recipient, you are hereby notified that any use, copying, distributing, dissemination, forwarding, printing, or copying of this e-mail is strictly prohibited. If you received this e-mail in error, please return the e-mail to the sender, delete it from your computer, and destroy any printed copy of it.

kamalsahu0001 commented 2 years ago

sonic# show bgp l2vpn evpn summary BGP router identifier 1.1.1.1, local AS number 65011 vrf-id 0 BGP table version 0 RIB entries 11, using 2112 bytes of memory Peers 3, using 64 KiB of memory

Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd PfxSnt 10.1.11.1 4 65101 39 70 0 0 0 00:00:07 2 6 10.1.12.1 4 65102 39 70 0 0 0 00:00:07 2 6 10.1.13.1 4 65103 39 70 0 0 0 00:00:07 2 6

Total number of neighbors 3 sonic# sonic# sonic# sonic# sonic# sonic# show bgp l2vpn evpn route detail BGP routing table entry for 10.10.101.1:1:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 10.10.101.1:1 BGP routing table entry for 10.10.101.1:1:[2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] VNI 101/101 65101 10.10.101.1 from 10.1.11.1 (10.10.1.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60101:101 ET:8 Last update: Thu Jul 22 20:08:39 2021 BGP routing table entry for 10.10.101.1:1:[3]:[0]:[32]:[10.10.101.1] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 65101 10.10.101.1 from 10.1.11.1 (10.10.1.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60101:101 ET:8 Last update: Thu Jul 22 20:08:39 2021 PMSI Tunnel Type: Ingress Replication, label: 0 BGP routing table entry for 10.10.102.1:1:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 10.10.102.1:1 BGP routing table entry for 10.10.102.1:1:[2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] VNI 102/102 65102 10.10.102.1 from 10.1.12.1 (10.10.2.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60102:102 ET:8 Last update: Thu Jul 22 20:08:39 2021 BGP routing table entry for 10.10.102.1:1:[3]:[0]:[32]:[10.10.102.1] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 65102 10.10.102.1 from 10.1.12.1 (10.10.2.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60102:102 ET:8 Last update: Thu Jul 22 20:08:39 2021 PMSI Tunnel Type: Ingress Replication, label: 0 BGP routing table entry for 10.10.103.1:1:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 10.10.103.1:1 BGP routing table entry for 10.10.103.1:1:[2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] VNI 103/103 65103 10.10.103.1 from 10.1.13.1 (10.10.3.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60103:103 ET:8 Last update: Thu Jul 22 20:08:39 2021 BGP routing table entry for 10.10.103.1:1:[3]:[0]:[32]:[10.10.103.1] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 65103 10.10.103.1 from 10.1.13.1 (10.10.3.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60103:103 ET:8 Last update: Thu Jul 22 20:08:39 2021 PMSI Tunnel Type: Ingress Replication, label: 0

Displayed 6 prefixes (6 paths) sonic# show bgp l2vpn evpn route vni all detail sonic# show bgp l2vpn evpn route vni all detail sonic# sonic# sonic# sonic# sonic# sonic# show bgp l2vpn evpn vni Advertise Gateway Macip: Disabled Advertise SVI Macip: Disabled Advertise All VNI flag: Enabled BUM flooding: Head-end replication Number of L2 VNIs: 0 Number of L3 VNIs: 0 Flags: - Kernel VNI Type RD Import RT Export RT Tenant VRF sonic# show evpn vni detail sonic# show evpn arp-cache vni all detail sonic# sonic# sonic# sonic# sonic# show evpn mac vni all detail sonic# show evpn rmac vni all sonic# sonic# sonic# sonic# sonic# sonic# show bgp l2vpn evpn BGP table version is 6, local router ID is 1.1.1.1 Status codes: s suppressed, d damped, h history, valid, > best, i - internal Origin codes: i - IGP, e - EGP, ? - incomplete EVPN type-1 prefix: [1]:[ESI]:[EthTag]:[IPlen]:[VTEP-IP] EVPN type-2 prefix: [2]:[EthTag]:[MAClen]:[MAC]:[IPlen]:[IP] EVPN type-3 prefix: [3]:[EthTag]:[IPlen]:[OrigIP] EVPN type-4 prefix: [4]:[ESI]:[IPlen]:[OrigIP] EVPN type-5 prefix: [5]:[EthTag]:[IPlen]:[IP]

Network Next Hop Metric LocPrf Weight Path Route Distinguisher: 10.10.101.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] 10.10.101.1 0 65101 i RT:60101:101 ET:8 > [3]:[0]:[32]:[10.10.101.1] 10.10.101.1 0 65101 i RT:60101:101 ET:8 Route Distinguisher: 10.10.102.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] 10.10.102.1 0 65102 i RT:60102:102 ET:8 > [3]:[0]:[32]:[10.10.102.1] 10.10.102.1 0 65102 i RT:60102:102 ET:8 Route Distinguisher: 10.10.103.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] 10.10.103.1 0 65103 i RT:60103:103 ET:8 > [3]:[0]:[32]:[10.10.103.1] 10.10.103.1 0 65103 i RT:60103:103 ET:8

Displayed 6 out of 6 total prefixes sonic# sonic# sonic# sonic# sonic# show bgp l2vpn evpn BGP table version is 6, local router ID is 1.1.1.1 Status codes: s suppressed, d damped, h history, * valid, > best, i - internal Origin codes: i - IGP, e - EGP, ? - incomplete EVPN type-1 prefix: [1]:[ESI]:[EthTag]:[IPlen]:[VTEP-IP] EVPN type-2 prefix: [2]:[EthTag]:[MAClen]:[MAC]:[IPlen]:[IP] EVPN type-3 prefix: [3]:[EthTag]:[IPlen]:[OrigIP] EVPN type-4 prefix: [4]:[ESI]:[IPlen]:[OrigIP] EVPN type-5 prefix: [5]:[EthTag]:[IPlen]:[IP]

Network Next Hop Metric LocPrf Weight Path Route Distinguisher: 10.10.101.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] 10.10.101.1 0 65101 i RT:60101:101 ET:8 > [3]:[0]:[32]:[10.10.101.1] 10.10.101.1 0 65101 i RT:60101:101 ET:8 Route Distinguisher: 10.10.102.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] 10.10.102.1 0 65102 i RT:60102:102 ET:8 > [3]:[0]:[32]:[10.10.102.1] 10.10.102.1 0 65102 i RT:60102:102 ET:8 Route Distinguisher: 10.10.103.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] 10.10.103.1 0 65103 i RT:60103:103 ET:8 > [3]:[0]:[32]:[10.10.103.1] 10.10.103.1 0 65103 i RT:60103:103 ET:8

Displayed 6 out of 6 total prefixes sonic# sonic# sonic# sonic# sonic# sonic# sonic# sonic# sonic#

kishorekunal01 commented 2 years ago

There is no vxlan interface created in FRR(Zebra). Zebra is not aware of any L2VNI. Please share the show output for "ip.link" as well.

On Fri, Jan 28, 2022 at 1:32 PM kamalsahu0001 @.***> wrote:

sonic# show bgp l2vpn evpn summary BGP router identifier 1.1.1.1, local AS number 65011 vrf-id 0 BGP table version 0 RIB entries 11, using 2112 bytes of memory Peers 3, using 64 KiB of memory

Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd PfxSnt 10.1.11.1 4 65101 39 70 0 0 0 00:00:07 2 6 10.1.12.1 4 65102 39 70 0 0 0 00:00:07 2 6 10.1.13.1 4 65103 39 70 0 0 0 00:00:07 2 6

Total number of neighbors 3 sonic# sonic# sonic# sonic# sonic# sonic# show bgp l2vpn evpn route detail BGP routing table entry for 10.10.101.1:1:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 10.10.101.1:1 BGP routing table entry for 10.10.101.1:1 :[2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] Paths: (1 available, best #1 https://github.com/Azure/sonic-buildimage/pull/1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] VNI 101/101 65101 10.10.101.1 from 10.1.11.1 (10.10.1.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60101:101 ET:8 Last update: Thu Jul 22 20:08:39 2021 BGP routing table entry for 10.10.101.1:1:[3]:[0]:[32]:[10.10.101.1] Paths: (1 available, best #1 https://github.com/Azure/sonic-buildimage/pull/1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 65101 10.10.101.1 from 10.1.11.1 (10.10.1.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60101:101 ET:8 Last update: Thu Jul 22 20:08:39 2021 PMSI Tunnel Type: Ingress Replication, label: 0 BGP routing table entry for 10.10.102.1:1:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 10.10.102.1:1 BGP routing table entry for 10.10.102.1:1 :[2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] Paths: (1 available, best #1 https://github.com/Azure/sonic-buildimage/pull/1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] VNI 102/102 65102 10.10.102.1 from 10.1.12.1 (10.10.2.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60102:102 ET:8 Last update: Thu Jul 22 20:08:39 2021 BGP routing table entry for 10.10.102.1:1:[3]:[0]:[32]:[10.10.102.1] Paths: (1 available, best #1 https://github.com/Azure/sonic-buildimage/pull/1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 65102 10.10.102.1 from 10.1.12.1 (10.10.2.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60102:102 ET:8 Last update: Thu Jul 22 20:08:39 2021 PMSI Tunnel Type: Ingress Replication, label: 0 BGP routing table entry for 10.10.103.1:1:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 10.10.103.1:1 BGP routing table entry for 10.10.103.1:1 :[2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] Paths: (1 available, best #1 https://github.com/Azure/sonic-buildimage/pull/1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] VNI 103/103 65103 10.10.103.1 from 10.1.13.1 (10.10.3.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60103:103 ET:8 Last update: Thu Jul 22 20:08:39 2021 BGP routing table entry for 10.10.103.1:1:[3]:[0]:[32]:[10.10.103.1] Paths: (1 available, best #1 https://github.com/Azure/sonic-buildimage/pull/1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 65103 10.10.103.1 from 10.1.13.1 (10.10.3.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60103:103 ET:8 Last update: Thu Jul 22 20:08:39 2021 PMSI Tunnel Type: Ingress Replication, label: 0

Displayed 6 prefixes (6 paths) sonic# show bgp l2vpn evpn route vni all detail sonic# show bgp l2vpn evpn route vni all detail sonic# sonic# sonic# sonic# sonic# sonic# show bgp l2vpn evpn vni Advertise Gateway Macip: Disabled Advertise SVI Macip: Disabled Advertise All VNI flag: Enabled BUM flooding: Head-end replication Number of L2 VNIs: 0 Number of L3 VNIs: 0 Flags: - Kernel VNI Type RD Import RT Export RT Tenant VRF sonic# show evpn vni detail sonic# show evpn arp-cache vni all detail sonic# sonic# sonic# sonic# sonic# show evpn mac vni all detail sonic# show evpn rmac vni all sonic# sonic# sonic# sonic# sonic# sonic# show bgp l2vpn evpn BGP table version is 6, local router ID is 1.1.1.1 Status codes: s suppressed, d damped, h history, valid, > best, i - internal Origin codes: i - IGP, e - EGP, ? - incomplete EVPN type-1 prefix: [1]:[ESI]:[EthTag]:[IPlen]:[VTEP-IP] EVPN type-2 prefix: [2]:[EthTag]:[MAClen]:[MAC]:[IPlen]:[IP] EVPN type-3 prefix: [3]:[EthTag]:[IPlen]:[OrigIP] EVPN type-4 prefix: [4]:[ESI]:[IPlen]:[OrigIP] EVPN type-5 prefix: [5]:[EthTag]:[IPlen]:[IP]

Network Next Hop Metric LocPrf Weight Path Route Distinguisher: 10.10.101.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] 10.10.101.1 0 65101 i RT:60101:101 ET:8 > [3]:[0]:[32]:[10.10.101.1] 10.10.101.1 0 65101 i RT:60101:101 ET:8 Route Distinguisher: 10.10.102.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] 10.10.102.1 0 65102 i RT:60102:102 ET:8 > [3]:[0]:[32]:[10.10.102.1] 10.10.102.1 0 65102 i RT:60102:102 ET:8 Route Distinguisher: 10.10.103.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] 10.10.103.1 0 65103 i RT:60103:103 ET:8 > [3]:[0]:[32]:[10.10.103.1] 10.10.103.1 0 65103 i RT:60103:103 ET:8

Displayed 6 out of 6 total prefixes sonic# sonic# sonic# sonic# sonic# show bgp l2vpn evpn BGP table version is 6, local router ID is 1.1.1.1 Status codes: s suppressed, d damped, h history, * valid, > best, i - internal Origin codes: i - IGP, e - EGP, ? - incomplete EVPN type-1 prefix: [1]:[ESI]:[EthTag]:[IPlen]:[VTEP-IP] EVPN type-2 prefix: [2]:[EthTag]:[MAClen]:[MAC]:[IPlen]:[IP] EVPN type-3 prefix: [3]:[EthTag]:[IPlen]:[OrigIP] EVPN type-4 prefix: [4]:[ESI]:[IPlen]:[OrigIP] EVPN type-5 prefix: [5]:[EthTag]:[IPlen]:[IP]

Network Next Hop Metric LocPrf Weight Path Route Distinguisher: 10.10.101.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] 10.10.101.1 0 65101 i RT:60101:101 ET:8 > [3]:[0]:[32]:[10.10.101.1] 10.10.101.1 0 65101 i RT:60101:101 ET:8 Route Distinguisher: 10.10.102.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] 10.10.102.1 0 65102 i RT:60102:102 ET:8 > [3]:[0]:[32]:[10.10.102.1] 10.10.102.1 0 65102 i RT:60102:102 ET:8 Route Distinguisher: 10.10.103.1:1 > [2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] 10.10.103.1 0 65103 i RT:60103:103 ET:8 > [3]:[0]:[32]:[10.10.103.1] 10.10.103.1 0 65103 i RT:60103:103 ET:8

Displayed 6 out of 6 total prefixes sonic# sonic# sonic# sonic# sonic# sonic# sonic# sonic# sonic#

— Reply to this email directly, view it on GitHub https://github.com/Azure/sonic-buildimage/issues/9028#issuecomment-1024658869, or unsubscribe https://github.com/notifications/unsubscribe-auth/APIREPFTZLMIT4E5NNO5AKLUYMDQDANCNFSM5GNJLRTA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

-- This electronic communication and the information and any files transmitted with it, or attached to it, are confidential and are intended solely for the use of the individual or entity to whom it is addressed and may contain information that is confidential, legally privileged, protected by privacy laws, or otherwise restricted from disclosure to anyone else. If you are not the intended recipient or the person responsible for delivering the e-mail to the intended recipient, you are hereby notified that any use, copying, distributing, dissemination, forwarding, printing, or copying of this e-mail is strictly prohibited. If you received this e-mail in error, please return the e-mail to the sender, delete it from your computer, and destroy any printed copy of it.

kamalsahu0001 commented 2 years ago

sonic_dump_sonic_20210722_220030.tar.gz

kishorekunal01 commented 2 years ago

Hi Kamal,

Please fix the SAI issue as suggested by Rajesh.

Here BGP routes are not imported as the vxlan interface is not created. ( sonic_dump_sonic_20210722_220030.tar.gz https://github.com/Azure/sonic-buildimage/files/7962473/sonic_dump_sonic_20210722_220030.tar.gz )

Where as the other TS you provided (sonic_dump_sonic_20210721_222140.tar.gz https://github.com/Azure/sonic-buildimage/files/7954606/sonic_dump_sonic_20210721_222140.tar.gz) has no BGP EVPN information to see if there was any route received from the remote node or not.

So please fix the SAI issue as suggested by Rajesh.

@prsunny https://github.com/prsunny Is it possible to collect below information as part of TS from vtysh.

save_vtysh "show bgp l2vpn evpn summary" "bgp.evpn.summary" save_vtysh "show bgp l2vpn evpn route detail" "bgp.evpn.routes" save_vtysh "show bgp l2vpn evpn route vni all detail" "bgp.evpn.vpn.routes" save_vtysh "show bgp l2vpn evpn vni" "bgp.evpn.vni" save_vtysh "show evpn vni detail" "frr.evpn.vni.detail" save_vtysh "show evpn arp-cache vni all detail" "frr.evpn.arp_cache.all" save_vtysh "show evpn mac vni all detail" "frr.evpn.mac.all" save_vtysh "show evpn rmac vni all" "frr.evpn.rmac.all"

Thanks and Regards, Kishore Kunal

On Fri, Jan 28, 2022 at 3:33 PM kamalsahu0001 @.***> wrote:

sonic_dump_sonic_20210722_220030.tar.gz https://github.com/Azure/sonic-buildimage/files/7962473/sonic_dump_sonic_20210722_220030.tar.gz

— Reply to this email directly, view it on GitHub https://github.com/Azure/sonic-buildimage/issues/9028#issuecomment-1024741246, or unsubscribe https://github.com/notifications/unsubscribe-auth/APIREPCONEETR44XB4FJ7O3UYMRS7ANCNFSM5GNJLRTA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

-- This electronic communication and the information and any files transmitted with it, or attached to it, are confidential and are intended solely for the use of the individual or entity to whom it is addressed and may contain information that is confidential, legally privileged, protected by privacy laws, or otherwise restricted from disclosure to anyone else. If you are not the intended recipient or the person responsible for delivering the e-mail to the intended recipient, you are hereby notified that any use, copying, distributing, dissemination, forwarding, printing, or copying of this e-mail is strictly prohibited. If you received this e-mail in error, please return the e-mail to the sender, delete it from your computer, and destroy any printed copy of it.

kamalsahu0001 commented 2 years ago

In case of sonic_dump_sonic_20210721_222140.tar.gz, policy was enforced under bgp so those routes are not advertised. In case of sonic_dump_sonic_20210722_220030.tar.gz, "no bgp ebgp-requires-policy" command is issued and the routes are advertised.

kamalsahu0001 commented 2 years ago

@kishorekunal01

requested output is pasted below.

sonic# show bgp l2vpn evpn summary BGP router identifier 1.1.1.1, local AS number 65011 vrf-id 0 BGP table version 0 RIB entries 11, using 2112 bytes of memory Peers 3, using 64 KiB of memory

Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd PfxSnt 10.1.11.1 4 65101 90 112 0 0 0 00:04:13 2 15 10.1.12.1 4 65102 90 112 0 0 0 00:04:13 2 15 10.1.13.1 4 65103 90 112 0 0 0 00:04:13 2 15

Total number of neighbors 3 sonic# sonic# sonic# sonic# show bgp l2vpn evpn route detail BGP routing table entry for 1.1.1.1:2:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer BGP routing table entry for 1.1.1.1:2:[2]:[0]:[48]:[00:12:01:00:00:01] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 1.1.1.1:2 BGP routing table entry for 1.1.1.1:2:[2]:[0]:[48]:[00:12:01:00:00:01] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[00:12:01:00:00:01] VNI 101 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:101 Last update: Tue Jul 27 22:27:08 2021 BGP routing table entry for 1.1.1.1:2:[2]:[0]:[48]:[00:12:01:00:00:01]:[32]:[172.1.101.200] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[00:12:01:00:00:01]:[32]:[172.1.101.200] VNI 101 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:101 Last update: Tue Jul 27 22:29:07 2021 BGP routing table entry for 1.1.1.1:2:[3]:[0]:[32]:[10.10.11.11] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [3]:[0]:[32]:[10.10.11.11] VNI 101 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:101 Last update: Tue Jul 27 22:26:52 2021 PMSI Tunnel Type: Ingress Replication, label: 101 BGP routing table entry for 1.1.1.1:3:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer BGP routing table entry for 1.1.1.1:3:[2]:[0]:[48]:[00:12:02:00:00:01] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 1.1.1.1:3 BGP routing table entry for 1.1.1.1:3:[2]:[0]:[48]:[00:12:02:00:00:01] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[00:12:02:00:00:01] VNI 102 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:102 Last update: Tue Jul 27 22:27:08 2021 BGP routing table entry for 1.1.1.1:3:[2]:[0]:[48]:[00:12:02:00:00:01]:[32]:[172.1.102.200] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[00:12:02:00:00:01]:[32]:[172.1.102.200] VNI 102 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:102 Last update: Tue Jul 27 22:29:08 2021 BGP routing table entry for 1.1.1.1:3:[3]:[0]:[32]:[10.10.11.11] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [3]:[0]:[32]:[10.10.11.11] VNI 102 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:102 Last update: Tue Jul 27 22:26:52 2021 PMSI Tunnel Type: Ingress Replication, label: 102 BGP routing table entry for 1.1.1.1:4:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer BGP routing table entry for 1.1.1.1:4:[2]:[0]:[48]:[00:12:03:00:00:01] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 1.1.1.1:4 BGP routing table entry for 1.1.1.1:4:[2]:[0]:[48]:[00:12:03:00:00:01] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[00:12:03:00:00:01] VNI 103 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:103 Last update: Tue Jul 27 22:27:08 2021 BGP routing table entry for 1.1.1.1:4:[2]:[0]:[48]:[00:12:03:00:00:01]:[32]:[172.1.103.200] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[00:12:03:00:00:01]:[32]:[172.1.103.200] VNI 103 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:103 Last update: Tue Jul 27 22:29:08 2021 BGP routing table entry for 1.1.1.1:4:[3]:[0]:[32]:[10.10.11.11] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [3]:[0]:[32]:[10.10.11.11] VNI 103 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:103 Last update: Tue Jul 27 22:26:52 2021 PMSI Tunnel Type: Ingress Replication, label: 103 BGP routing table entry for 10.10.101.1:1:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 10.10.101.1:1 BGP routing table entry for 10.10.101.1:1:[2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] VNI 101/101 65101 10.10.101.1 from 10.1.11.1 (10.10.1.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60101:101 ET:8 Last update: Tue Jul 27 22:27:13 2021 BGP routing table entry for 10.10.101.1:1:[3]:[0]:[32]:[10.10.101.1] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [3]:[0]:[32]:[10.10.101.1] 65101 10.10.101.1 from 10.1.11.1 (10.10.1.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60101:101 ET:8 Last update: Tue Jul 27 22:27:13 2021 PMSI Tunnel Type: Ingress Replication, label: 0 BGP routing table entry for 10.10.102.1:1:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 10.10.102.1:1 BGP routing table entry for 10.10.102.1:1:[2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] VNI 102/102 65102 10.10.102.1 from 10.1.12.1 (10.10.2.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60102:102 ET:8 Last update: Tue Jul 27 22:27:13 2021 BGP routing table entry for 10.10.102.1:1:[3]:[0]:[32]:[10.10.102.1] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [3]:[0]:[32]:[10.10.102.1] 65102 10.10.102.1 from 10.1.12.1 (10.10.2.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60102:102 ET:8 Last update: Tue Jul 27 22:27:13 2021 PMSI Tunnel Type: Ingress Replication, label: 0 BGP routing table entry for 10.10.103.1:1:[2]:[0]:[48]:[00:00:00:00:00:00] Paths: (0 available, no best path) Not advertised to any peer Route Distinguisher: 10.10.103.1:1 BGP routing table entry for 10.10.103.1:1:[2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] VNI 103/103 65103 10.10.103.1 from 10.1.13.1 (10.10.3.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60103:103 ET:8 Last update: Tue Jul 27 22:27:13 2021 BGP routing table entry for 10.10.103.1:1:[3]:[0]:[32]:[10.10.103.1] Paths: (1 available, best #1) Advertised to non peer-group peers: 10.1.11.1 10.1.12.1 10.1.13.1 Route [3]:[0]:[32]:[10.10.103.1] 65103 10.10.103.1 from 10.1.13.1 (10.10.3.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60103:103 ET:8 Last update: Tue Jul 27 22:27:13 2021 PMSI Tunnel Type: Ingress Replication, label: 0

Displayed 15 prefixes (15 paths) sonic# show bgp l2vpn evpn route vni all detail

VNI: 101

Route [2]:[0]:[48]:[00:12:01:00:00:01] VNI 101 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:101 Last update: Tue Jul 27 22:27:08 2021 Route [2]:[0]:[48]:[00:12:01:00:00:01]:[32]:[172.1.101.200] VNI 101 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:101 Last update: Tue Jul 27 22:29:07 2021 Route [2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] VNI 101/101 Imported from 10.10.101.1:1:[2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3], VNI 101/101 65101 10.10.101.1 from 10.1.11.1 (10.10.1.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60101:101 ET:8 Last update: Tue Jul 27 22:27:13 2021 Route [3]:[0]:[32]:[10.10.11.11] VNI 101 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:101 Last update: Tue Jul 27 22:26:52 2021 PMSI Tunnel Type: Ingress Replication, label: 101 Route [3]:[0]:[32]:[10.10.101.1] Imported from 10.10.101.1:1:[3]:[0]:[32]:[10.10.101.1], VNI 65101 10.10.101.1 from 10.1.11.1 (10.10.1.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60101:101 ET:8 Last update: Tue Jul 27 22:27:13 2021 PMSI Tunnel Type: Ingress Replication, label: 0

Displayed 5 prefixes (5 paths)

VNI: 102

Route [2]:[0]:[48]:[00:12:02:00:00:01] VNI 102 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:102 Last update: Tue Jul 27 22:27:08 2021 Route [2]:[0]:[48]:[00:12:02:00:00:01]:[32]:[172.1.102.200] VNI 102 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:102 Last update: Tue Jul 27 22:29:08 2021 Route [2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3] VNI 102/102 Imported from 10.10.102.1:1:[2]:[0]:[48]:[a0:11:01:00:00:02]:[32]:[172.1.102.3], VNI 102/102 65102 10.10.102.1 from 10.1.12.1 (10.10.2.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60102:102 ET:8 Last update: Tue Jul 27 22:27:13 2021 Route [3]:[0]:[32]:[10.10.11.11] VNI 102 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:102 Last update: Tue Jul 27 22:26:52 2021 PMSI Tunnel Type: Ingress Replication, label: 102 Route [3]:[0]:[32]:[10.10.102.1] Imported from 10.10.102.1:1:[3]:[0]:[32]:[10.10.102.1], VNI 65102 10.10.102.1 from 10.1.12.1 (10.10.2.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60102:102 ET:8 Last update: Tue Jul 27 22:27:13 2021 PMSI Tunnel Type: Ingress Replication, label: 0

Displayed 5 prefixes (5 paths)

VNI: 103

Route [2]:[0]:[48]:[00:12:03:00:00:01] VNI 103 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:103 Last update: Tue Jul 27 22:27:08 2021 Route [2]:[0]:[48]:[00:12:03:00:00:01]:[32]:[172.1.103.200] VNI 103 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:103 Last update: Tue Jul 27 22:29:08 2021 Route [2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3] VNI 103/103 Imported from 10.10.103.1:1:[2]:[0]:[48]:[a0:11:01:00:00:03]:[32]:[172.1.103.3], VNI 103/103 65103 10.10.103.1 from 10.1.13.1 (10.10.3.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60103:103 ET:8 Last update: Tue Jul 27 22:27:13 2021 Route [3]:[0]:[32]:[10.10.11.11] VNI 103 Local 10.10.11.11 from 0.0.0.0 (1.1.1.1) Origin IGP, weight 32768, valid, sourced, local, best (First path received) Extended Community: ET:8 RT:65011:103 Last update: Tue Jul 27 22:26:52 2021 PMSI Tunnel Type: Ingress Replication, label: 103 Route [3]:[0]:[32]:[10.10.103.1] Imported from 10.10.103.1:1:[3]:[0]:[32]:[10.10.103.1], VNI 65103 10.10.103.1 from 10.1.13.1 (10.10.3.1) Origin IGP, valid, external, best (First path received) Extended Community: RT:60103:103 ET:8 Last update: Tue Jul 27 22:27:13 2021 PMSI Tunnel Type: Ingress Replication, label: 0

Displayed 5 prefixes (5 paths)

sonic# show bgp l2vpn evpn route vni % Command incomplete: show bgp l2vpn evpn route vni sonic# show bgp l2vpn evpn route vni % Command incomplete: show bgp l2vpn evpn route vni sonic# show bgp l2vpn evpn route vni (1-16777215) VNI number all All VNIs sonic# show bgp l2vpn evpn route vni 101 BGP table version is 5, local router ID is 1.1.1.1 Status codes: s suppressed, d damped, h history, * valid, > best, i - internal Origin codes: i - IGP, e - EGP, ? - incomplete EVPN type-1 prefix: [1]:[ESI]:[EthTag]:[IPlen]:[VTEP-IP] EVPN type-2 prefix: [2]:[EthTag]:[MAClen]:[MAC]:[IPlen]:[IP] EVPN type-3 prefix: [3]:[EthTag]:[IPlen]:[OrigIP] EVPN type-4 prefix: [4]:[ESI]:[IPlen]:[OrigIP] EVPN type-5 prefix: [5]:[EthTag]:[IPlen]:[IP]

Network Next Hop Metric LocPrf Weight Path > [2]:[0]:[48]:[00:12:01:00:00:01] 10.10.11.11 32768 i ET:8 RT:65011:101 > [2]:[0]:[48]:[00:12:01:00:00:01]:[32]:[172.1.101.200] 10.10.11.11 32768 i ET:8 RT:65011:101 > [2]:[0]:[48]:[a0:11:01:00:00:01]:[32]:[172.1.101.3] 10.10.101.1 0 65101 i RT:60101:101 ET:8 > [3]:[0]:[32]:[10.10.11.11] 10.10.11.11 32768 i ET:8 RT:65011:101 *> [3]:[0]:[32]:[10.10.101.1] 10.10.101.1 0 65101 i RT:60101:101 ET:8

Displayed 5 prefixes (5 paths)

sonic# show evpn vni detail VNI: 101 Type: L2 Tenant VRF: default VxLAN interface: vtep-101 VxLAN ifIndex: 45 Local VTEP IP: 10.10.11.11 Mcast group: 0.0.0.0 Remote VTEPs for this VNI: 10.10.101.1 flood: HER Number of MACs (local and remote) known for this VNI: 3 Number of ARPs (IPv4 and IPv6, local and remote) known for this VNI: 4 Advertise-gw-macip: No

VNI: 102 Type: L2 Tenant VRF: default VxLAN interface: vtep-102 VxLAN ifIndex: 46 Local VTEP IP: 10.10.11.11 Mcast group: 0.0.0.0 Remote VTEPs for this VNI: 10.10.102.1 flood: HER Number of MACs (local and remote) known for this VNI: 3 Number of ARPs (IPv4 and IPv6, local and remote) known for this VNI: 4 Advertise-gw-macip: No

VNI: 103 Type: L2 Tenant VRF: default VxLAN interface: vtep-103 VxLAN ifIndex: 47 Local VTEP IP: 10.10.11.11 Mcast group: 0.0.0.0 Remote VTEPs for this VNI: 10.10.103.1 flood: HER Number of MACs (local and remote) known for this VNI: 3 Number of ARPs (IPv4 and IPv6, local and remote) known for this VNI: 4 Advertise-gw-macip: No

sonic# show evpn arp-cache vni all detail

VNI 101 #ARP (IPv4 and IPv6, local and remote) 4

IP: fe80::923c:b3ff:fe94:847e Type: local State: active MAC: 90:3c:b3:94:84:7e Sync-info: - Local Seq: 0 Remote Seq: 0 IP: 172.1.101.1 Type: local State: active MAC: 90:3c:b3:94:84:7e Sync-info: - Local Seq: 0 Remote Seq: 0 IP: 172.1.101.200 Type: local State: active MAC: 00:12:01:00:00:01 Sync-info: - Local Seq: 0 Remote Seq: 0 IP: 172.1.101.3 Type: remote State: active MAC: a0:11:01:00:00:01 Sync-info: - Remote VTEP: 10.10.101.1 Local Seq: 0 Remote Seq: 0

VNI 102 #ARP (IPv4 and IPv6, local and remote) 4

IP: 172.1.102.200 Type: local State: active MAC: 00:12:02:00:00:01 Sync-info: - Local Seq: 0 Remote Seq: 0 IP: fe80::923c:b3ff:fe94:847e Type: local State: active MAC: 90:3c:b3:94:84:7e Sync-info: - Local Seq: 0 Remote Seq: 0 IP: 172.1.102.1 Type: local State: active MAC: 90:3c:b3:94:84:7e Sync-info: - Local Seq: 0 Remote Seq: 0 IP: 172.1.102.3 Type: remote State: active MAC: a0:11:01:00:00:02 Sync-info: - Remote VTEP: 10.10.102.1 Local Seq: 0 Remote Seq: 0

VNI 103 #ARP (IPv4 and IPv6, local and remote) 4

IP: 172.1.103.200 Type: local State: active MAC: 00:12:03:00:00:01 Sync-info: - Local Seq: 0 Remote Seq: 0 IP: fe80::923c:b3ff:fe94:847e Type: local State: active MAC: 90:3c:b3:94:84:7e Sync-info: - Local Seq: 0 Remote Seq: 0 IP: 172.1.103.1 Type: local State: active MAC: 90:3c:b3:94:84:7e Sync-info: - Local Seq: 0 Remote Seq: 0 IP: 172.1.103.3 Type: remote State: active MAC: a0:11:01:00:00:03 Sync-info: - Remote VTEP: 10.10.103.1 Local Seq: 0 Remote Seq: 0 sonic# show evpn mac vni all detail

VNI 101 #MACs (local and remote) 3

MAC: a0:11:01:00:00:01 Remote VTEP: 10.10.101.1 Sync-info: neigh#: 0 Local Seq: 0 Remote Seq: 0 Neighbors: 172.1.101.3 Active

MAC: 90:3c:b3:94:84:7e Intf: Vlan101(42) VLAN: 101 Default-gateway Mac Sync-info: neigh#: 0 Local Seq: 0 Remote Seq: 0 Neighbors: 172.1.101.1 Active fe80::923c:b3ff:fe94:847e Active

MAC: 00:12:01:00:00:01 Intf: Ethernet100(32) VLAN: 101 Sync-info: neigh#: 0 Local Seq: 0 Remote Seq: 0 Neighbors: 172.1.101.200 Active

VNI 102 #MACs (local and remote) 3

MAC: 90:3c:b3:94:84:7e Intf: Vlan102(43) VLAN: 102 Default-gateway Mac Sync-info: neigh#: 0 Local Seq: 0 Remote Seq: 0 Neighbors: 172.1.102.1 Active fe80::923c:b3ff:fe94:847e Active

MAC: a0:11:01:00:00:02 Remote VTEP: 10.10.102.1 Sync-info: neigh#: 0 Local Seq: 0 Remote Seq: 0 Neighbors: 172.1.102.3 Active

MAC: 00:12:02:00:00:01 Intf: Ethernet100(32) VLAN: 102 Sync-info: neigh#: 0 Local Seq: 0 Remote Seq: 0 Neighbors: 172.1.102.200 Active

VNI 103 #MACs (local and remote) 3

MAC: 00:12:03:00:00:01 Intf: Ethernet100(32) VLAN: 103 Sync-info: neigh#: 0 Local Seq: 0 Remote Seq: 0 Neighbors: 172.1.103.200 Active

MAC: 90:3c:b3:94:84:7e Intf: Vlan103(44) VLAN: 103 Default-gateway Mac Sync-info: neigh#: 0 Local Seq: 0 Remote Seq: 0 Neighbors: 172.1.103.1 Active fe80::923c:b3ff:fe94:847e Active

MAC: a0:11:01:00:00:03 Remote VTEP: 10.10.103.1 Sync-info: neigh#: 0 Local Seq: 0 Remote Seq: 0 Neighbors: 172.1.103.3 Active

sonic# show evpn rmac vni all sonic# sonic# sonic# show evpn rmac vni all sonic#

kamalsahu0001 commented 2 years ago

sonic_dump_sonic_20210727_223535.tar.gz

kishorekunal01 commented 2 years ago

As expected when vxlan interface is present in the system, EVPN route are imported and APP_DB for VXLAN is populated correctly.

"VXLAN_REMOTE_VNI_TABLE:Vlan101:10.10.101.1": { "expireat": 1627425367.006665, "ttl": -0.001, "type": "hash", "value": { "vni": "101" } }, "VXLAN_REMOTE_VNI_TABLE:Vlan102:10.10.102.1": { "expireat": 1627425367.0073202, "ttl": -0.001, "type": "hash", "value": { "vni": "102" } }, "VXLAN_REMOTE_VNI_TABLE:Vlan103:10.10.103.1": { "expireat": 1627425367.006685, "ttl": -0.001, "type": "hash", "value": { "vni": "103" } },

"VXLAN_FDB_TABLE:Vlan101:a0:11:01:00:00:01": { "expireat": 1627425367.0066202, "ttl": -0.001, "type": "hash", "value": { "remote_vtep": "10.10.101.1", "type": "dynamic", "vni": "101" } }, "VXLAN_FDB_TABLE:Vlan102:a0:11:01:00:00:02": { "expireat": 1627425367.0063782, "ttl": -0.001, "type": "hash", "value": { "remote_vtep": "10.10.102.1", "type": "dynamic", "vni": "102" } }, "VXLAN_FDB_TABLE:Vlan103:a0:11:01:00:00:03": { "expireat": 1627425367.0064101, "ttl": -0.001, "type": "hash", "value": { "remote_vtep": "10.10.103.1", "type": "dynamic", "vni": "103" } },

So no issue from the BGP EVPN side.

Thanks and Regards, Kishore Kunal

On Wed, Feb 2, 2022 at 3:58 PM kamalsahu0001 @.***> wrote:

sonic_dump_sonic_20210727_223535.tar.gz https://github.com/Azure/sonic-buildimage/files/7990812/sonic_dump_sonic_20210727_223535.tar.gz

— Reply to this email directly, view it on GitHub https://github.com/Azure/sonic-buildimage/issues/9028#issuecomment-1028470223, or unsubscribe https://github.com/notifications/unsubscribe-auth/APIREPECEG2FCPBYYJRWC4LUZHAMDANCNFSM5GNJLRTA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

-- This electronic communication and the information and any files transmitted with it, or attached to it, are confidential and are intended solely for the use of the individual or entity to whom it is addressed and may contain information that is confidential, legally privileged, protected by privacy laws, or otherwise restricted from disclosure to anyone else. If you are not the intended recipient or the person responsible for delivering the e-mail to the intended recipient, you are hereby notified that any use, copying, distributing, dissemination, forwarding, printing, or copying of this e-mail is strictly prohibited. If you received this e-mail in error, please return the e-mail to the sender, delete it from your computer, and destroy any printed copy of it.

kamalsahu0001 commented 2 years ago

Even after the routes are present, It shows remote vtep's as down.

kamalsahu0001 commented 2 years ago

@prsunny ... what is the next step here? as we can see the routes getting installed correctly, is it because of software issue that it shows tunnel as down?

hari-selvam commented 1 year ago

@kamalsahu0001 We are also facing the same issue in TD3(X5) based platform. I think in BRCM chipset based platforms, we can fetch 'dst_ip' field from STATE_DB's 'VXLAN_TUNNEL_TABLE'. And also in CONFIG_DB's 'VXLAN_TUNNEL' we have only 'src_ip' field and not 'dst_ip' field. May I know still this issue is open?

sonic-net / sonic-buildimage

VxLan tunnel information is not shown properly while configuring EVPN (tunnel destination remains blank) #9028