search

sonic-net / sonic-mgmt

Configuration management examples for SONiC
Other
195 stars 707 forks source link

PortChannel is down while bringup the T1-LAG topology. #829

Open mdasari-brcm opened 5 years ago

mdasari-brcm commented 5 years ago

Description

When bringing up the T1-LAG topology, PortChannel on VM is not coming up. Where as the PortChannel on SONIC DUT is Up. When we tried to get some TCPDUMP on the DUT and one of the VM's, we are observing that VM is sending the LACP packet with Partner information as all ZEROS.

[admin@ARISTA01T2 ~]$ tcpdump -vv -i et1 
tcpdump: WARNING: et1: no IPv4 address assigned
tcpdump: listening on et1, link-type EN10MB (Ethernet), capture size 65535 bytes
07:30:05.375373 52:54:00:4c:d7:43 (oui Unknown) > 01:80:c2:00:00:02 (oui Unknown), ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
  Actor Information TLV (0x01), length 20
    System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 1, Port Priority 32768
    State Flags [Activity, Aggregation, Default]
    0x0000:  8000 5254 001a 2a4b 0001 8000 0001 4500
    0x0010:  0000
  Partner Information TLV (0x02), length 20
    System 00:00:00:00:00:00 (oui Ethernet), System Priority 0, Key 0, Port 0, Port Priority 0
    State Flags [Timeout]
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0200
    0x0010:  0000
  Collector Information TLV (0x03), length 16
    Max Delay 0
    0x0000:  0000 0000 0000 0000 0000 0000 0000
  Terminator TLV (0x00), length 0 (=52)
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0010:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0020:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0030:  0000

But where as the DUT is sending properly. Attached the details.

root@sonic:~# tcpdump -v -i Ethernet0
tcpdump: listening on Ethernet0, link-type EN10MB (Ethernet), capture size 262144 bytes
17:19:48.715443 LACPv1, length 110
        Actor Information TLV (0x01), length 20
          System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 1, Port Priority 32768
          State Flags [Activity, Aggregation, Default]
        Partner Information TLV (0x02), length 20
          System 00:00:00:00:00:00 (oui Ethernet), System Priority 0, Key 0, Port 0, Port Priority 0
          State Flags [Timeout]
        Collector Information TLV (0x03), length 16
          Max Delay 0
        Terminator TLV (0x00), length 0

root@sonic:~# tcpdump -v -i Ethernet0 ether host 70:72:cf:b7:68:72
17:23:45.797930 LACPv1, length 110
        Actor Information TLV (0x01), length 20
          System 70:72:cf:b7:68:72 (oui Unknown), System Priority 65535, Key 0, Port 1, Port Priority 255
          State Flags [Activity, Aggregation, Synchronization, Collecting, Distributing]
        Partner Information TLV (0x02), length 20
          System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 1, Port Priority 32768
          State Flags [Activity, Aggregation, Default]
        Collector Information TLV (0x03), length 16
          Max Delay 0
        Terminator TLV (0x00), length 0

Steps to reproduce the issue:

  1. Connect the topology as specified in wiki and change the required files (veos, lab, testbed.csv ..etc).
  2. Bring up the VMs using the testbed-cli.sh command (./testbed-cli.sh start-vms server_1 password.txt)
  3. Bring up the t1-lag topology using the testbed-cli.sh command (./testbed-cli.sh add-topo vms-asr5712-t1-lag password.txt)
  4. Deploy the minigraph using the testbed-cli.sh command (./testbed-cli.sh deploy-mg vms-asr5712-t1-lag lab password.txt)
  5. Observe that the BGP sessions for PortChannel are still in Active state.

Describe the results you received:

BGP Sessions are in Active state.

Describe the results you expected:

BGP Sessions should be in Established state.

Output of "show version":

root@sonic:~# show version
SONiC Software Version: SONiC.broadcom_sonic_201811_1.0.0-252f711
Distribution: Debian 9.7
Kernel: 4.9.0-8-amd64
Build commit: 252f711
Build date: Mon Feb 11 01:10:19 UTC 2019
Built by: vmuser@server1

Docker images:
REPOSITORY                 TAG                                   IMAGE ID            SIZE
docker-syncd-brcm          broadcom_sonic_201811_1.0.0-252f711   8ce402711344        360MB
docker-syncd-brcm          latest                                8ce402711344        360MB
docker-orchagent-brcm      broadcom_sonic_201811_1.0.0-252f711   da302611b2a4        285MB
docker-orchagent-brcm      latest                                da302611b2a4        285MB
docker-dhcp-relay          broadcom_sonic_201811_1.0.0-252f711   4b6840cca2af        255MB
docker-dhcp-relay          latest                                4b6840cca2af        255MB
docker-database            broadcom_sonic_201811_1.0.0-252f711   8f73400fa2e5        254MB
docker-database            latest                                8f73400fa2e5        254MB
docker-snmp-sv2            broadcom_sonic_201811_1.0.0-252f711   0bb7c831fbf2        293MB
docker-snmp-sv2            latest                                0bb7c831fbf2        293MB
docker-teamd               broadcom_sonic_201811_1.0.0-252f711   4af60654a79c        273MB
docker-teamd               latest                                4af60654a79c        273MB
docker-router-advertiser   broadcom_sonic_201811_1.0.0-252f711   2a36d92df13e        251MB
docker-router-advertiser   latest                                2a36d92df13e        251MB
docker-platform-monitor    broadcom_sonic_201811_1.0.0-252f711   233dc0f74a5f        285MB
docker-platform-monitor    latest                                233dc0f74a5f        285MB
docker-lldp-sv2            broadcom_sonic_201811_1.0.0-252f711   8618fa16f6df        273MB
docker-lldp-sv2            latest                                8618fa16f6df        273MB
docker-fpm-frr             broadcom_sonic_201811_1.0.0-252f711   2c326329d386        280MB
docker-fpm-frr             latest                                2c326329d386        280MB

root@sonic:~#

Configuration and other details on a VM:

ARISTA01T2#
ARISTA01T2#show running-config interfaces Port-Channel 1
interface Port-Channel1
   no switchport
   ip address 10.0.0.1/31
   ipv6 enable
   ipv6 address fc00::2/126
   ipv6 nd ra suppress
   port-channel min-links 2
ARISTA01T2#

ARISTA01T2#show running-config interfaces Ethernet 1-2
interface Ethernet1
   no switchport
   channel-group 1 mode active
interface Ethernet2
   no switchport
   channel-group 1 mode active
ARISTA01T2#
ARISTA01T2#

ARISTA01T2#show interfaces Port-Channel 1
Port-Channel1 is down, line protocol is lowerlayerdown (notconnect)
  Hardware is Port-Channel, address is 5254.001a.2a4b
  Internet address is 10.0.0.1/31
  Broadcast address is 255.255.255.255
  Address determined by manual configuration
  IP MTU 1500 bytes
  Full-duplex, Unconfigured 
  Active members in this channel: 0
  Fallback mode is: off
  Down 26 minutes, 41 seconds
  1 link status changes since last clear
  Last clearing of "show interface" counters never
  5 minutes input rate 0 bps (- with framing overhead), 0 packets/sec
  5 minutes output rate 0 bps (- with framing overhead), 0 packets/sec
     0 packets input, 0 bytes
     Received 0 broadcasts, 0 multicast
     0 input errors, 0 input discards
     0 packets output, 0 bytes
     Sent 0 broadcasts, 0 multicast
     0 output errors, 0 output discards
ARISTA01T2#

ARISTA01T2#show interfaces Ethernet 1-2
Ethernet1 is up, line protocol is up (connected)
  Hardware is Ethernet, address is 5254.004c.d743 (bia 5254.004c.d743)
  Member of Port-Channel1
  Ethernet MTU 9214 bytes
  Full-duplex, Unconfigured, auto negotiation: off, uni-link: n/a
  Up 2 days, 11 hours, 12 minutes, 21 seconds
  Loopback Mode : None
  3 link status changes since last clear
  Last clearing of "show interface" counters never
  5 minutes input rate 0 bps (- with framing overhead), 0 packets/sec
  5 minutes output rate 0 bps (- with framing overhead), 0 packets/sec
     24094 packets input, 3249228 bytes
     Received 9996 broadcasts, 14098 multicast
     0 runts, 0 giants
     0 input errors, 0 CRC, 0 alignment, 0 symbol, 0 input discards
     0 PAUSE input
     220566 packets output, 28575744 bytes
     Sent 0 broadcasts, 220566 multicast
     0 output errors, 0 collisions
     0 late collision, 0 deferred, 0 output discards
     0 PAUSE output
Ethernet2 is up, line protocol is up (connected)
  Hardware is Ethernet, address is 5254.00c5.5c7e (bia 5254.00c5.5c7e)
  Member of Port-Channel1
  Ethernet MTU 9214 bytes
  Full-duplex, Unconfigured, auto negotiation: off, uni-link: n/a
  Up 2 days, 11 hours, 12 minutes, 21 seconds
  Loopback Mode : None
  3 link status changes since last clear
  Last clearing of "show interface" counters never
  5 minutes input rate 0 bps (- with framing overhead), 0 packets/sec
  5 minutes output rate 0 bps (- with framing overhead), 0 packets/sec
     19567 packets input, 3089010 bytes
     Received 474 broadcasts, 19093 multicast
     0 runts, 0 giants
     0 input errors, 0 CRC, 0 alignment, 0 symbol, 0 input discards
     0 PAUSE input
     220566 packets output, 28575744 bytes
     Sent 0 broadcasts, 220566 multicast
     0 output errors, 0 collisions
     0 late collision, 0 deferred, 0 output discards
     0 PAUSE output
ARISTA01T2#

ARISTA01T2#show port-channel summary 

                 Flags                                                          
------------------------ ---------------------------- ------------------------- 
  a - LACP Active          p - LACP Passive           * - static fallback       
  F - Fallback enabled     f - Fallback configured    ^ - individual fallback   
  U - In Use               D - Down                                             
  + - In-Sync              - - Out-of-Sync            i - incompatible with agg 
  P - bundled in Po        s - suspended              G - Aggregable            
  I - Individual           S - ShortTimeout           w - wait for agg          

Number of channels in use: 0
Number of aggregators: 0

   Port-Channel       Protocol    Ports            
------------------ -------------- ---------------- 
   Po1(D)             LACP(a)     Et1(G-) Et2(G-)  

ARISTA01T2#

ARISTA01T2#show port-channel detailed 
Port Channel Port-Channel1 (Fallback State: Unconfigured):
  No Active Ports
  Configured, but inactive ports:
    Port        Time became inactive  Reason unconfigured                       
    ---------- ---------------------- ----------------------------------------- 
    Ethernet1   Always                Link down while waiting for LACP response 
    Ethernet2   Always                Link down while waiting for LACP response 

ARISTA01T2#

TCPDUMP on VM:

ARISTA01T2#bash

Arista Networks EOS shell

[admin@ARISTA01T2 ~]$ 
[admin@ARISTA01T2 ~]$ tcpdump -vv -i et1 
tcpdump: WARNING: et1: no IPv4 address assigned
tcpdump: listening on et1, link-type EN10MB (Ethernet), capture size 65535 bytes
07:30:05.375373 52:54:00:4c:d7:43 (oui Unknown) > 01:80:c2:00:00:02 (oui Unknown), ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
  Actor Information TLV (0x01), length 20
    System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 1, Port Priority 32768
    State Flags [Activity, Aggregation, Default]
    0x0000:  8000 5254 001a 2a4b 0001 8000 0001 4500
    0x0010:  0000
  Partner Information TLV (0x02), length 20
    System 00:00:00:00:00:00 (oui Ethernet), System Priority 0, Key 0, Port 0, Port Priority 0
    State Flags [Timeout]
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0200
    0x0010:  0000
  Collector Information TLV (0x03), length 16
    Max Delay 0
    0x0000:  0000 0000 0000 0000 0000 0000 0000
  Terminator TLV (0x00), length 0 (=52)
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0010:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0020:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0030:  0000
07:30:06.375095 52:54:00:4c:d7:43 (oui Unknown) > 01:80:c2:00:00:02 (oui Unknown), ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
  Actor Information TLV (0x01), length 20
    System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 1, Port Priority 32768
    State Flags [Activity, Aggregation, Default]
    0x0000:  8000 5254 001a 2a4b 0001 8000 0001 4500
    0x0010:  0000
  Partner Information TLV (0x02), length 20
    System 00:00:00:00:00:00 (oui Ethernet), System Priority 0, Key 0, Port 0, Port Priority 0
    State Flags [Timeout]
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0200
    0x0010:  0000
  Collector Information TLV (0x03), length 16
    Max Delay 0
    0x0000:  0000 0000 0000 0000 0000 0000 0000
  Terminator TLV (0x00), length 0 (=52)
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0010:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0020:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0030:  0000
^C
2 packets captured
2 packets received by filter
0 packets dropped by kernel
[admin@ARISTA01T2 ~]$ 

[admin@ARISTA01T2 ~]$ tcpdump -vv -i et2  
tcpdump: WARNING: et2: no IPv4 address assigned
tcpdump: listening on et2, link-type EN10MB (Ethernet), capture size 65535 bytes
07:33:18.515660 52:54:00:c5:5c:7e (oui Unknown) > 01:80:c2:00:00:02 (oui Unknown), ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
  Actor Information TLV (0x01), length 20
    System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 2, Port Priority 32768
    State Flags [Activity, Aggregation, Default]
    0x0000:  8000 5254 001a 2a4b 0001 8000 0002 4500
    0x0010:  0000
  Partner Information TLV (0x02), length 20
    System 00:00:00:00:00:00 (oui Ethernet), System Priority 0, Key 0, Port 0, Port Priority 0
    State Flags [Timeout]
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0200
    0x0010:  0000
  Collector Information TLV (0x03), length 16
    Max Delay 0
    0x0000:  0000 0000 0000 0000 0000 0000 0000
  Terminator TLV (0x00), length 0 (=52)
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0010:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0020:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0030:  0000
07:33:19.525473 52:54:00:c5:5c:7e (oui Unknown) > 01:80:c2:00:00:02 (oui Unknown), ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
  Actor Information TLV (0x01), length 20
    System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 2, Port Priority 32768
    State Flags [Activity, Aggregation, Default]
    0x0000:  8000 5254 001a 2a4b 0001 8000 0002 4500
    0x0010:  0000
  Partner Information TLV (0x02), length 20
    System 00:00:00:00:00:00 (oui Ethernet), System Priority 0, Key 0, Port 0, Port Priority 0
    State Flags [Timeout]
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0200
    0x0010:  0000
  Collector Information TLV (0x03), length 16
    Max Delay 0
    0x0000:  0000 0000 0000 0000 0000 0000 0000
  Terminator TLV (0x00), length 0 (=52)
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0010:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0020:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0030:  0000
^X^C
2 packets captured
2 packets received by filter
0 packets dropped by kernel
[admin@ARISTA01T2 ~]$ 

[admin@ARISTA01T2 ~]$ tcpdump -vv -i et1 ether host 70:72:cf:b7:68:72
tcpdump: WARNING: et1: no IPv4 address assigned
tcpdump: listening on et1, link-type EN10MB (Ethernet), capture size 65535 bytes
07:45:52.726537 70:72:cf:b7:68:72 (oui Unknown) > 01:80:c2:00:00:0e (oui Unknown), ethertype LLDP (0x88cc), length 224: LLDP, length 210
  Chassis ID TLV (1), length 7
    Subtype MAC address (4): 70:72:cf:b7:68:72 (oui Unknown)
    0x0000:  0470 72cf b768 72
  Port ID TLV (2), length 7
    Subtype MAC address (3): 70:72:cf:b7:68:72 (oui Unknown)
    0x0000:  0370 72cf b768 72
  Time to Live TLV (3), length 2: TTL 120s
    0x0000:  0078
  System Name TLV (5), length 5: sonic
    0x0000:  736f 6e69 63
  System Description TLV (6), length 98
    Debian GNU/Linux 8 (jessie) Linux 4.9.0-8-amd64 #1 SMP Debian 4.9.110-3+deb9u6 (2015-12-19) x86_64
    0x0000:  4465 6269 616e 2047 4e55 2f4c 696e 7578
    0x0010:  2038 2028 6a65 7373 6965 2920 4c69 6e75
    0x0020:  7820 342e 392e 302d 382d 616d 6436 3420
    0x0030:  2331 2053 4d50 2044 6562 6961 6e20 342e
    0x0040:  392e 3131 302d 332b 6465 6239 7536 2028
    0x0050:  3230 3135 2d31 322d 3139 2920 7838 365f
    0x0060:  3634
  System Capabilities TLV (7), length 4
    System  Capabilities [Bridge, WLAN AP, Router, Station Only] (0x009c)
    Enabled Capabilities [Bridge, Router] (0x0014)
    0x0000:  009c 0014
  Management Address TLV (8), length 12
    Management Address length 5, AFI IPv4 (1): 10.1.0.1
    Interface Index Interface Numbering (2): 1
    0x0000:  0501 0a01 0001 0200 0000 0100
  Management Address TLV (8), length 24
    Management Address length 17, AFI IPv6 (2): fc00:1::32
    Interface Index Interface Numbering (2): 1
    0x0000:  1102 fc00 0001 0000 0000 0000 0000 0000
    0x0010:  0032 0200 0000 0100
  Port Description TLV (4), length 9: Ethernet0
    0x0000:  4574 6865 726e 6574 30
  Organization specific TLV (127), length 9: OUI IEEE 802.3 Private (0x00120f)
    Link aggregation Subtype (3)
      aggregation status [supported], aggregation port ID 0
    0x0000:  0012 0f03 0100 0000 00
  Organization specific TLV (127), length 9: OUI IEEE 802.3 Private (0x00120f)
    MAC/PHY configuration/status Subtype (1)
      autonegotiation [none] (0x00)
      PMD autoneg capability [unknown] (0x0000)
      MAU type Unknown (0x0000)
    0x0000:  0012 0f01 0000 0000 00
  End TLV (0), length 0
07:46:12.478364 70:72:cf:b7:68:72 (oui Unknown) > 01:80:c2:00:00:02 (oui Unknown), ethertype 802.1Q (0x8100), length 128: vlan 1681, p 0, ethertype Slow Protocols, LACPv1, length 110
  Actor Information TLV (0x01), length 20
    System 70:72:cf:b7:68:72 (oui Unknown), System Priority 65535, Key 0, Port 1, Port Priority 255
    State Flags [Activity, Aggregation, Synchronization, Collecting, Distributing]
    0x0000:  ffff 7072 cfb7 6872 0000 00ff 0001 3d00
    0x0010:  0000
  Partner Information TLV (0x02), length 20
    System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 1, Port Priority 32768
    State Flags [Activity, Aggregation, Default]
    0x0000:  8000 5254 001a 2a4b 0001 8000 0001 4500
    0x0010:  0000
  Collector Information TLV (0x03), length 16
    Max Delay 0
    0x0000:  0000 0000 0000 0000 0000 0000 0000
  Terminator TLV (0x00), length 0 (=52)
    0x0000:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0010:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0020:  0000 0000 0000 0000 0000 0000 0000 0000
    0x0030:  0000
^C
2 packets captured
2 packets received by filter
0 packets dropped by kernel
1 packet dropped by interface
[admin@ARISTA01T2 ~]$

Configuration and other details on DUT:

root@sonic:~# teamshow
Flags: A - active, I - inactive, Up - up, Dw - Down, N/A - not available, S - selected, D - deselected
  No.  Team Dev         Protocol     Ports
-----  ---------------  -----------  ---------------------------
 0002  PortChannel0002  LACP(A)(Up)  Ethernet0(S) Ethernet1(S)
 0005  PortChannel0005  LACP(A)(Up)  Ethernet2(S) Ethernet3(S)
 0008  PortChannel0008  LACP(A)(Up)  Ethernet4(S) Ethernet5(S)
 0011  PortChannel0011  LACP(A)(Up)  Ethernet6(S) Ethernet7(S)
 0014  PortChannel0014  LACP(A)(Up)  Ethernet8(S) Ethernet9(S)
 0017  PortChannel0017  LACP(A)(Up)  Ethernet10(S) Ethernet11(S)
 0020  PortChannel0020  LACP(A)(Up)  Ethernet12(S) Ethernet13(S)
 0023  PortChannel0023  LACP(A)(Up)  Ethernet14(S) Ethernet15(S)
root@sonic:~#
root@sonic:~# vtysh

Hello, this is FRRouting (version 4.0).
Copyright 1996-2005 Kunihiro Ishiguro, et al.

sonic# show interface PortChannel0002
Interface PortChannel0002 is up, line protocol is up
  Link ups:       1    last: 2016/12/10 17:08:15.79
  Link downs:     0    last: (never)
  PTM status: disabled
  vrf: Default-IP-Routing-Table
  index 1694 metric 0 mtu 9100 speed 0
  flags: <UP,BROADCAST,RUNNING,MULTICAST>
  Type: Ethernet
  HWaddr: 70:72:cf:b7:68:72
  inet 10.0.0.0/31
  inet6 fc00::1/126
  inet6 fe80::7272:cfff:feb7:6872/64
  Interface Type Other
sonic#

sonic# show ip bgp summary

IPv4 Unicast Summary:
BGP router identifier 10.1.0.32, local AS number 65100 vrf-id 0
BGP table version 98
RIB entries 195, using 29 KiB of memory
Peers 48, using 926 KiB of memory

Neighbor        V         AS MsgRcvd MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd
10.0.0.1        4      65200       0       0        0    0    0    never       Active
10.0.0.5        4      65200       0       0        0    0    0    never       Active
10.0.0.9        4      65200       0       0        0    0    0    never       Active
10.0.0.13       4      65200       0       0        0    0    0    never       Active
10.0.0.17       4      65200       0       0        0    0    0    never       Active
10.0.0.21       4      65200       0       0        0    0    0    never       Active
10.0.0.25       4      65200       0       0        0    0    0    never       Active
10.0.0.29       4      65200       0       0        0    0    0    never       Active
10.0.0.33       4      64001     203     233        0    0    0 00:09:49            7
10.0.0.35       4      64002     201     232        0    0    0 00:09:48            6
10.0.0.37       4      64003     203     233        0    0    0 00:09:49            7
10.0.0.39       4      64004     202     233        0    0    0 00:09:49            6
10.0.0.41       4      64005     201     232        0    0    0 00:09:48            6
10.0.0.43       4      64006     202     233        0    0    0 00:09:49            6
10.0.0.45       4      64007     202     233        0    0    0 00:09:49            6
10.0.0.47       4      64008     202     233        0    0    0 00:09:49            6
10.0.0.49       4      64009     202     233        0    0    0 00:09:49            6
10.0.0.51       4      64010     202     233        0    0    0 00:09:49            6
10.0.0.53       4      64011     202     233        0    0    0 00:09:49            6
10.0.0.55       4      64012     201     233        0    0    0 00:09:48            6
10.0.0.57       4      64013     201     233        0    0    0 00:09:48            6
10.0.0.59       4      64014     201     232        0    0    0 00:09:48            6
10.0.0.61       4      64015     201     232        0    0    0 00:09:48            6
10.0.0.63       4      64016     201     232        0    0    0 00:09:47            6

Total number of neighbors 24
sonic#
sonic# exit
root@sonic:~#

TCPDUMP on DUT :

root@sonic:~# tcpdump -v -i Ethernet0
tcpdump: listening on Ethernet0, link-type EN10MB (Ethernet), capture size 262144 bytes
17:19:48.715443 LACPv1, length 110
        Actor Information TLV (0x01), length 20
          System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 1, Port Priority 32768
          State Flags [Activity, Aggregation, Default]
        Partner Information TLV (0x02), length 20
          System 00:00:00:00:00:00 (oui Ethernet), System Priority 0, Key 0, Port 0, Port Priority 0
          State Flags [Timeout]
        Collector Information TLV (0x03), length 16
          Max Delay 0
        Terminator TLV (0x00), length 0
17:19:49.715757 LACPv1, length 110
        Actor Information TLV (0x01), length 20
          System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 1, Port Priority 32768
          State Flags [Activity, Aggregation, Default]
        Partner Information TLV (0x02), length 20
          System 00:00:00:00:00:00 (oui Ethernet), System Priority 0, Key 0, Port 0, Port Priority 0
          State Flags [Timeout]
        Collector Information TLV (0x03), length 16
          Max Delay 0
        Terminator TLV (0x00), length 0
^C
2 packets captured
2 packets received by filter
0 packets dropped by kernel
root@sonic:~#

root@sonic:~# tcpdump -v -i Ethernet1
tcpdump: listening on Ethernet1, link-type EN10MB (Ethernet), capture size 262144 bytes
17:20:17.827706 LACPv1, length 110
        Actor Information TLV (0x01), length 20
          System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 2, Port Priority 32768
          State Flags [Activity, Aggregation, Default]
        Partner Information TLV (0x02), length 20
          System 00:00:00:00:00:00 (oui Ethernet), System Priority 0, Key 0, Port 0, Port Priority 0
          State Flags [Timeout]
        Collector Information TLV (0x03), length 16
          Max Delay 0
        Terminator TLV (0x00), length 0
17:20:18.828875 LACPv1, length 110
        Actor Information TLV (0x01), length 20
          System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 2, Port Priority 32768
          State Flags [Activity, Aggregation, Default]
        Partner Information TLV (0x02), length 20
          System 00:00:00:00:00:00 (oui Ethernet), System Priority 0, Key 0, Port 0, Port Priority 0
          State Flags [Timeout]
        Collector Information TLV (0x03), length 16
          Max Delay 0
        Terminator TLV (0x00), length 0
^C
2 packets captured
2 packets received by filter
0 packets dropped by kernel
root@sonic:~#

root@sonic:~# tcpdump -v -i Ethernet0 ether host 70:72:cf:b7:68:72
tcpdump: listening on Ethernet0, link-type EN10MB (Ethernet), capture size 262144 bytes
17:23:06.598599 LLDP, length 223
        Chassis ID TLV (1), length 7
          Subtype MAC address (4): 70:72:cf:b7:68:72 (oui Unknown)
        Port ID TLV (2), length 9
          Subtype Local (7): tenGigE0
        Time to Live TLV (3), length 2: TTL 120s
        System Name TLV (5), length 5: sonic
        System Description TLV (6), length 98
          Debian GNU/Linux 8 (jessie) Linux 4.9.0-8-amd64 #1 SMP Debian 4.9.110-3+deb9u6 (2015-12-19) x86_64
        System Capabilities TLV (7), length 4
          System  Capabilities [Bridge, WLAN AP, Router, Station Only] (0x009c)
          Enabled Capabilities [Bridge, Router] (0x0014)
        Management Address TLV (8), length 12
          Management Address length 5, AFI IPv4 (1): 10.1.0.1
          Interface Index Interface Numbering (2): 1
        Management Address TLV (8), length 24
          Management Address length 17, AFI IPv6 (2): fc00:1::32
          Interface Index Interface Numbering (2): 1
        Port Description TLV (4), length 20: ARISTA01T2:Ethernet1
        Organization specific TLV (127), length 9: OUI IEEE 802.3 Private (0x00120f)
          Link aggregation Subtype (3)
            aggregation status [supported], aggregation port ID 0
        Organization specific TLV (127), length 9: OUI IEEE 802.3 Private (0x00120f)
          MAC/PHY configuration/status Subtype (1)
            autonegotiation [none] (0x00)
            PMD autoneg capability [unknown] (0x0000)
            MAU type Unknown (0x0000)
        End TLV (0), length 0
17:23:15.797928 LACPv1, length 110
        Actor Information TLV (0x01), length 20
          System 70:72:cf:b7:68:72 (oui Unknown), System Priority 65535, Key 0, Port 1, Port Priority 255
          State Flags [Activity, Aggregation, Synchronization, Collecting, Distributing]
        Partner Information TLV (0x02), length 20
          System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 1, Port Priority 32768
          State Flags [Activity, Aggregation, Default]
        Collector Information TLV (0x03), length 16
          Max Delay 0
        Terminator TLV (0x00), length 0
17:23:45.797930 LACPv1, length 110
        Actor Information TLV (0x01), length 20
          System 70:72:cf:b7:68:72 (oui Unknown), System Priority 65535, Key 0, Port 1, Port Priority 255
          State Flags [Activity, Aggregation, Synchronization, Collecting, Distributing]
        Partner Information TLV (0x02), length 20
          System 52:54:00:1a:2a:4b (oui Unknown), System Priority 32768, Key 1, Port 1, Port Priority 32768
          State Flags [Activity, Aggregation, Default]
        Collector Information TLV (0x03), length 16
          Max Delay 0
        Terminator TLV (0x00), length 0
17:23:46.649374 LLDP, length 223
        Chassis ID TLV (1), length 7
          Subtype MAC address (4): 70:72:cf:b7:68:72 (oui Unknown)
        Port ID TLV (2), length 9
          Subtype Local (7): tenGigE0
        Time to Live TLV (3), length 2: TTL 120s
        System Name TLV (5), length 5: sonic
        System Description TLV (6), length 98
          Debian GNU/Linux 8 (jessie) Linux 4.9.0-8-amd64 #1 SMP Debian 4.9.110-3+deb9u6 (2015-12-19) x86_64
        System Capabilities TLV (7), length 4
          System  Capabilities [Bridge, WLAN AP, Router, Station Only] (0x009c)
          Enabled Capabilities [Bridge, Router] (0x0014)
        Management Address TLV (8), length 12
          Management Address length 5, AFI IPv4 (1): 10.1.0.1
          Interface Index Interface Numbering (2): 1
        Management Address TLV (8), length 24
          Management Address length 17, AFI IPv6 (2): fc00:1::32
          Interface Index Interface Numbering (2): 1
        Port Description TLV (4), length 20: ARISTA01T2:Ethernet1
        Organization specific TLV (127), length 9: OUI IEEE 802.3 Private (0x00120f)
          Link aggregation Subtype (3)
            aggregation status [supported], aggregation port ID 0
        Organization specific TLV (127), length 9: OUI IEEE 802.3 Private (0x00120f)
          MAC/PHY configuration/status Subtype (1)
            autonegotiation [none] (0x00)
            PMD autoneg capability [unknown] (0x0000)
            MAU type Unknown (0x0000)
        End TLV (0), length 0
^C
4 packets captured
4 packets received by filter
0 packets dropped by kernel
root@sonic:~#

LLDP on DUT :

root@sonic:~# show lldp table
Capability codes: (R) Router, (B) Bridge, (O) Other
LocalPort    RemoteDevice         RemotePortID    Capability    RemotePortDescr
-----------  -------------------  --------------  ------------  -----------------
Ethernet0    ARISTA01T2           Ethernet1       BR
Ethernet1    ARISTA01T2           Ethernet2       BR
Ethernet2    ARISTA03T2           Ethernet1       BR
Ethernet3    ARISTA03T2           Ethernet2       BR
Ethernet4    ARISTA05T2           Ethernet1       BR
Ethernet5    ARISTA05T2           Ethernet2       BR
Ethernet6    ARISTA07T2           Ethernet1       BR
Ethernet7    ARISTA07T2           Ethernet2       BR
Ethernet8    ARISTA09T2           Ethernet1       BR
Ethernet9    ARISTA09T2           Ethernet2       BR
Ethernet10   ARISTA11T2           Ethernet1       BR
Ethernet11   ARISTA11T2           Ethernet2       BR
Ethernet12   ARISTA13T2           Ethernet1       BR
Ethernet13   ARISTA13T2           Ethernet2       BR
Ethernet14   ARISTA15T2           Ethernet1       BR
Ethernet15   ARISTA15T2           Ethernet2       BR
Ethernet16   ARISTA01T0           Ethernet1       BR
Ethernet17   ARISTA02T0           Ethernet1       BR
Ethernet18   ARISTA03T0           Ethernet1       BR
Ethernet19   ARISTA04T0           Ethernet1       BR
Ethernet20   ARISTA05T0           Ethernet1       BR
Ethernet21   ARISTA06T0           Ethernet1       BR
Ethernet22   ARISTA07T0           Ethernet1       BR
Ethernet23   ARISTA08T0           Ethernet1       BR
Ethernet24   ARISTA09T0           Ethernet1       BR
Ethernet25   ARISTA10T0           Ethernet1       BR
Ethernet26   ARISTA11T0           Ethernet1       BR
Ethernet27   ARISTA12T0           Ethernet1       BR
Ethernet28   ARISTA13T0           Ethernet1       BR
Ethernet29   ARISTA14T0           Ethernet1       BR
Ethernet30   ARISTA15T0           Ethernet1       BR
Ethernet31   ARISTA16T0           Ethernet1       BR
eth0         dhcp-10-130-185-218  1/0/2           BR            1/0/2
--------------------------------------------------
Total entries displayed:  33
root@sonic:~#

LLDP on VM :

ARISTA01T2#show lldp neighbors 
Last table change time   : 0:01:28 ago
Number of table inserts  : 354
Number of table deletes  : 352
Number of table drops    : 0
Number of table age-outs : 2

Port       Neighbor Device ID               Neighbor Port ID           TTL
Et1        sonic                            7072.cfb7.6872             120
Et2        sonic                            7072.cfb7.6872             120
ARISTA01T2#

We are trying to bring up different topologies provided in SONIC wiki https://github.com/Azure/sonic-mgmt/blob/master/ansible/doc/README.testbed.Topology.md. We are able to bring up T1, PTF32 topologies. When we started working on T1-LAG topology, we observed above issue.

We are using 2 NON-ARISTA boxes as LEAF and ROOT FANOUT switches. We configured both these FANOUT switches as per the requirement and also enabled LLDP LACP forwarding. We tried capturing the packets on both the switches and we see the same behavior(LACP packets with all zeros as partner information).

We are using AS5712 as our SONIC DUT.

stephengzh commented 4 years ago

I met the same issue while bring up the T0 topology. Can I ask how did you fix this issue?

kamalsahu0001 commented 3 years ago

If anybody is still looking for this issue, it can be resolved by setting "channel-group 1 mode on" and on SONiC DUT while creating the portchannels, set --fallback option to true.

nnelluri928 commented 3 weeks ago

HI I am also hitting this issue for T1-LAG topology. Can you let me know how to resolve this issue.