Closed javcasalc closed 5 years ago
Issue seems to be specific to routes of Type: EVPN-Nat Can we please enable "debug bgp updates" on the FRR side and confirm?
Hi
I have enabled debug, but I got no debug logs.....¿?¿?
FRRbgpd# sh debugging
BGP debugging status:
BGP neighbor-events debugging is on
BGP next-hop tracking debugging is on
BGP updates debugging is on (inbound)
BGP updates debugging is on (outbound)
BGP zebra debugging is on
FRRbgpd# clear bgp *2018/05/16 11:21:05 BGP: : %NOTIFICATION: sent to neighbor 12.0.2.110 6/4 (Cease/Administratively Reset) 0 bytes
2018/05/16 11:21:05 BGP: : %NOTIFICATION: sent to neighbor 12.0.2.111 6/4 (Cease/Administratively Reset) 0 bytes
2018/05/16 11:21:05 BGP: : %ADJCHANGE: neighbor 12.0.2.110(Unknown) in vrf Default Down Neighbor deleted
2018/05/16 11:21:05 BGP: : %ADJCHANGE: neighbor 12.0.2.111(Unknown) in vrf Default Down Neighbor deleted
FRRbgpd# 2018/05/16 11:21:05 BGP: : %ADJCHANGE: neighbor 12.0.2.110(Unknown) in vrf Default Up
2018/05/16 11:21:05 BGP: : %ADJCHANGE: neighbor 12.0.2.111(Unknown) in vrf Default Up
FRRbgpd# show bgp l2vpn evpn all overlay
Route Distinguisher: as2 65000:111
*>i[2]:[00:01:21:35:17:95]/224
34.246.2.81 00:00:00:00:00:00:00:00:00:00
*>i[2]:[00:01:21:35:17:95]:[fe80::201:21ff:fe35:1795]
34.246.2.81 00:00:00:00:00:00:00:00:00:00/::
Route Distinguisher: as2 65534:35174
*>i[5]:[0][100.64.1.0/24]/224
34.246.2.81 00:00:00:00:00:00:00:00:00:00/0.0.0.0/00:01:21:35:17:95
Displayed 3 out of 3 total prefixes
FRRbgpd# show bgp l2vpn evpn all tags
Route Distinguisher: as2 65000:111
*>i[2]:[00:01:21:35:17:95]/224
34.246.2.81 *>i[2]:[00:01:21:35:17:95]:[fe80::201:21ff:fe35:1795]
34.246.2.81 Route Distinguisher: as2 65534:35174
*>i[5]:[0][100.64.1.0/24]/224
34.246.2.81
Displayed 3 out of 3 total prefixes
what does show log
say where the log files are going?
ok, it was a log level issue. Now I have a complete debug:
FRRbgpd# clear bgp *
2018/05/16 13:30:21 BGP: : %NOTIFICATION: sent to neighbor 12.0.2.110 6/4 (Cease/Administratively Reset) 0 bytes
2018/05/16 13:30:21 BGP: : %NOTIFICATION: sent to neighbor 12.0.2.111 6/4 (Cease/Administratively Reset) 0 bytes
2018/05/16 13:30:21 BGP: : 12.0.2.110 [FSM] BGP_Stop (Established->Clearing), fd 20
2018/05/16 13:30:21 BGP: : 12.0.2.110 (dynamic neighbor) deleted
2018/05/16 13:30:21 BGP: : 12.0.2.110 dropped from group fabric, count 1
2018/05/16 13:30:21 BGP: : %ADJCHANGE: neighbor 12.0.2.110(Unknown) in vrf Default Down Neighbor deleted
2018/05/16 13:30:21 BGP: : 12.0.2.110 went from Established to Deleted
2018/05/16 13:30:21 BGP: : 12.0.2.111 [FSM] BGP_Stop (Established->Clearing), fd 22
2018/05/16 13:30:21 BGP: : 12.0.2.111 (dynamic neighbor) deleted
2018/05/16 13:30:21 BGP: : 12.0.2.111 dropped from group fabric, count 0
2018/05/16 13:30:21 BGP: : %ADJCHANGE: neighbor 12.0.2.111(Unknown) in vrf Default Down Neighbor deleted
2018/05/16 13:30:21 BGP: : 12.0.2.111 went from Established to Deleted
FRRbgpd# 2018/05/16 13:30:21 BGP: : Dynamic Neighbor 12.0.2.111/32 matches group fabric listen range 12.0.0.0/16
2018/05/16 13:30:21 BGP: : 12.0.2.111 Dynamic Neighbor added, group fabric count 1
2018/05/16 13:30:21 BGP: : 12.0.2.111 went from Idle to Active
2018/05/16 13:30:21 BGP: : 12.0.2.111 [FSM] TCP_connection_open (Active->OpenSent), fd 20
2018/05/16 13:30:21 BGP: : 12.0.2.111 open active, local address 12.0.2.129
2018/05/16 13:30:21 BGP: : 12.0.2.111 Sending hostname cap with hn = FRRbgpd, dn = (null)
2018/05/16 13:30:21 BGP: : 12.0.2.111 sending OPEN, version 4, my as 65000, holdtime 180, id 12.0.2.129
2018/05/16 13:30:21 BGP: : 12.0.2.111 went from Active to OpenSent
2018/05/16 13:30:21 BGP: : 12.0.2.111 rcv OPEN, version 4, remote-as (in open) 65000, holdtime 90, id 2.2.2.2
2018/05/16 13:30:21 BGP: : 12.0.2.111 rcv OPEN w/ OPTION parameter len: 16
2018/05/16 13:30:21 BGP: : 12.0.2.111 rcvd OPEN w/ optional parameter type 2 (Capability) len 14
2018/05/16 13:30:21 BGP: : 12.0.2.111 OPEN has MultiProtocol Extensions capability (1), length 4
2018/05/16 13:30:21 BGP: : 12.0.2.111 OPEN has MP_EXT CAP for afi/safi: 25/70
2018/05/16 13:30:21 BGP: : 12.0.2.111 OPEN has Route Refresh capability (2), length 0
2018/05/16 13:30:21 BGP: : 12.0.2.111 OPEN has 4-octet AS number capability (65), length 4
2018/05/16 13:30:21 BGP: : 12.0.2.111 [FSM] Receive_OPEN_message (OpenSent->OpenConfirm), fd 20
2018/05/16 13:30:21 BGP: : 12.0.2.111 went from OpenSent to OpenConfirm
2018/05/16 13:30:21 BGP: : 12.0.2.111 [FSM] Receive_KEEPALIVE_message (OpenConfirm->Established), fd 20
2018/05/16 13:30:21 BGP: : 12.0.2.111 went from OpenConfirm to Established
2018/05/16 13:30:21 BGP: : %ADJCHANGE: neighbor 12.0.2.111(Unknown) in vrf Default Up
2018/05/16 13:30:21 BGP: : 12.0.2.111 [FSM] Timer (routeadv timer expire)
2018/05/16 13:30:21 BGP: : Dynamic Neighbor 12.0.2.110/32 matches group fabric listen range 12.0.0.0/16
2018/05/16 13:30:21 BGP: : 12.0.2.110 Dynamic Neighbor added, group fabric count 2
2018/05/16 13:30:21 BGP: : 12.0.2.110 went from Idle to Active
2018/05/16 13:30:21 BGP: : 12.0.2.110 [FSM] TCP_connection_open (Active->OpenSent), fd 22
2018/05/16 13:30:21 BGP: : 12.0.2.110 open active, local address 12.0.2.129
2018/05/16 13:30:21 BGP: : 12.0.2.110 Sending hostname cap with hn = FRRbgpd, dn = (null)
2018/05/16 13:30:21 BGP: : 12.0.2.110 sending OPEN, version 4, my as 65000, holdtime 180, id 12.0.2.129
2018/05/16 13:30:21 BGP: : 12.0.2.110 went from Active to OpenSent
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcv OPEN, version 4, remote-as (in open) 65000, holdtime 90, id 1.2.3.4
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcv OPEN w/ OPTION parameter len: 16
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcvd OPEN w/ optional parameter type 2 (Capability) len 14
2018/05/16 13:30:21 BGP: : 12.0.2.110 OPEN has MultiProtocol Extensions capability (1), length 4
2018/05/16 13:30:21 BGP: : 12.0.2.110 OPEN has MP_EXT CAP for afi/safi: 25/70
2018/05/16 13:30:21 BGP: : 12.0.2.110 OPEN has Route Refresh capability (2), length 0
2018/05/16 13:30:21 BGP: : 12.0.2.110 OPEN has 4-octet AS number capability (65), length 4
2018/05/16 13:30:21 BGP: : 12.0.2.110 [FSM] Receive_OPEN_message (OpenSent->OpenConfirm), fd 22
2018/05/16 13:30:21 BGP: : 12.0.2.110 went from OpenSent to OpenConfirm
2018/05/16 13:30:21 BGP: : 12.0.2.110 [FSM] Receive_KEEPALIVE_message (OpenConfirm->Established), fd 22
2018/05/16 13:30:21 BGP: : 12.0.2.110 went from OpenConfirm to Established
2018/05/16 13:30:21 BGP: : %ADJCHANGE: neighbor 12.0.2.110(Unknown) in vrf Default Up
2018/05/16 13:30:21 BGP: : 12.0.2.110 [FSM] Timer (routeadv timer expire)
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcvd UPDATE w/ attr: nexthop 33.53.23.149, localpref 200, metric 0, extcommunity RT:65000:111 ? ? ? ET:8, path
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcvd UPDATE wlen 0 attrlen 131 alen 0
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcvd UPDATE w/ attr: nexthop 34.246.2.81, localpref 200, metric 0, extcommunity RT:65000:111 ? ? ? ? ? ? ET:8 Rmac:00:01:21:35:17:95, path
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcvd UPDATE wlen 0 attrlen 145 alen 0
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcvd RD 65534:35174 [5]:[0][100.64.1.0/24]/224 label 6 l2vpn evpn
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcvd UPDATE w/ attr: nexthop 34.246.2.81, localpref 200, metric 0, extcommunity RT:65000:111 ? ET:8, path
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcvd UPDATE wlen 0 attrlen 147 alen 0
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcvd RD 65000:111 [2]:[00:01:21:35:17:95]:[fe80::201:21ff:fe35:1795] label 6 l2vpn evpn
2018/05/16 13:30:21 BGP: : 12.0.2.110 rcvd RD 65000:111 [2]:[00:01:21:35:17:95]/224 label 6 l2vpn evpn
2018/05/16 13:30:22 BGP: : u5:s7 announcing routes upon coalesce timer expiry
2018/05/16 13:30:22 BGP: : u5:s7 send UPDATE w/ attr: nexthop 34.246.2.81, localpref 200, metric 0, extcommunity RT:65000:111 ? ET:8, path
2018/05/16 13:30:22 BGP: : u5:s7 send MP_REACH for afi/safi 25/70
2018/05/16 13:30:22 BGP: : u5:s7 send UPDATE RD 65000:111 [2]:[00:01:21:35:17:95]/224 label 6 l2vpn evpn
2018/05/16 13:30:22 BGP: : u5:s7 send UPDATE RD 65000:111 [2]:[00:01:21:35:17:95]:[fe80::201:21ff:fe35:1795] label 6 l2vpn evpn
2018/05/16 13:30:22 BGP: : u5:s7 send UPDATE len 185 numpfx 2
2018/05/16 13:30:22 BGP: : u5:s7 12.0.2.110 send UPDATE w/ nexthop 34.246.2.81
2018/05/16 13:30:22 BGP: : u5:s7 send UPDATE w/ attr: nexthop 34.246.2.81, localpref 200, metric 0, extcommunity RT:65000:111 ? ? ? ? ? ? ET:8 Rmac:00:01:21:35:17:95, path
2018/05/16 13:30:22 BGP: : u5:s7 send MP_REACH for afi/safi 25/70
2018/05/16 13:30:22 BGP: : u5:s7 send UPDATE RD 65534:35174 [5]:[0][100.64.1.0/24]/224 label 6 l2vpn evpn
2018/05/16 13:30:22 BGP: : u5:s7 send UPDATE len 183 numpfx 1
2018/05/16 13:30:22 BGP: : u5:s7 12.0.2.110 send UPDATE w/ nexthop 34.246.2.81
2018/05/16 13:30:22 BGP: : u5:s7 12.0.2.111 send UPDATE w/ nexthop 34.246.2.81
2018/05/16 13:30:22 BGP: : u5:s7 12.0.2.111 send UPDATE w/ nexthop 34.246.2.81
2018/05/16 13:30:22 BGP: : 12.0.2.110 [FSM] Timer (routeadv timer expire)
2018/05/16 13:30:22 BGP: : 12.0.2.111 [FSM] Timer (routeadv timer expire)
oops.....closed?
I will be working on this bug
@javcasalc
I have a similar setup with Router reflector configured. Tested for route types 2, 3, 5 and I don’t see any issues in my setup and route reflector does exchange all the routes as expected..
Trying to understand more on the issue & setup and I have the below questions.
EVPN-Nat routes include information about nat-ted openflow endpoints. I think is a non-standard implementation made by Nuage/Nokia SR-OS. Let me check it.
Thanks for your help. Javier.
@javcasalc Would it be possible for you to capture (with fx. tcpdump) the BGP update messages relevant to EVPN route type 'EVPN-Nat' received on in incoming interface on the host running FRR-RR ?
And maybe also posting a snippet of relevant raw config lines from 'peer 1' device you have running SR OS regarding the configured EVPN-Nat route(s)? (Thinking I may be able to find references to information in the SR OS config manuals by Nokia (0),(1),(2))
Was looking at VPN Route Types and draft-ietf-bess-dci-evpn-overlay (co-authored by Nokia people and first edition published Jan 16, 2015). Thinking it is maybe (!) still an IETF draft document which Nokia has implemented in SR OS.
@javcasalc Thanks for the quick reply. I still didn't find any relevant IETF draft on this. But as @netravnen suggested, may be the packet dumps can reveal on why FRR BGP is not processing these packets on the RR. Please provide this if possible. Let us know. Thanks.
@ghankins: Would you perhaps have any input to this issue? (Thinking maybe a hint to what Type: EVPN-Nat
is exactly)
No response from author.
Hi I have a FRR 4.0.1 configured as RR server with this config:
Then I have two BGP peers configured as RR-clients, running Nuage/Nokia SR-OS.
I have peer 1 announcing these prefixes:
but peer-2 is getting only these prefixes:
The question is: does FRR support this kind of config, RR-server for EVPN environments?
Thanks. J.