sonic-net / sonic-buildimage

Scripts which perform an installable binary image build for SONiC
Other
742 stars 1.43k forks source link

Broadcom ethernet ports are not coming-up in Arista Device 7050CX3-32S with Credo Dual-ToR (100G) cable [Used image from SONiC 202111 branch] #10733

Open GAcharyaIndia opened 2 years ago

GAcharyaIndia commented 2 years ago

Hi,

I am from Credo, while doing some testing/verification with 202111 SONiC branch found below issue. Need help on this.

Broadcom Ethernet ports are not coming up with Credo Dual-ToR (100G) Y-cable with SONiC 202111 branch, while same ports are coming up fine with SONiC 202012 branch .

Note: Same configuration and device has been used, during testing using 202012 branch and 202111 branch

Device used: Arista 7050CX3-32S

Status: SONiC 202111 branch: Not working (Ports are not coming up with Credo 100G Y-cable) SONiC 202012 branch: Working (Ports are coming up fine with Credo 100G Y-cable)

Below are the command outputs when running with 202111 branch image: admin@sonic:~$ show ver SONiC Software Version: SONiC.202111.0-0d8b769ba Distribution: Debian 11.3 Kernel: 5.10.0-8-2-amd64 Build commit: 0d8b769ba Build date: Sun May 1 11:24:49 UTC 2022 Built by: ford@ford

Platform: x86_64-arista_7050cx3_32s HwSKU: Arista-7050CX3-32S-C32 ASIC: broadcom ASIC Count: 1 Serial Number: JAS18080098 Model Number: DCS-7050CX3-32S Hardware Revision: 01.00

admin@sonic:~$ show interfaces status Interface Lanes Speed MTU FEC Alias Vlan Oper Admin Type Asym PFC


Ethernet0 1,2,3,4 100G 9100 none Ethernet1/1 routed down up N/A off Ethernet4 5,6,7,8 100G 9100 none Ethernet2/1 routed down up QSFP28 or later off Ethernet8 9,10,11,12 100G 9100 none Ethernet3/1 routed down up QSFP28 or later off Ethernet12 13,14,15,16 100G 9100 none Ethernet4/1 routed down up N/A off Ethernet16 21,22,23,24 100G 9100 N/A Ethernet5/1 routed down up N/A N/A Ethernet20 17,18,19,20 100G 9100 N/A Ethernet6/1 routed down up N/A N/A Ethernet24 25,26,27,28 100G 9100 N/A Ethernet7/1 routed down up N/A N/A

admin@sonic:~$ show ip int Interface Master IPv4 address/mask Admin/Oper BGP Neighbor Neighbor IP


Ethernet0 10.0.0.0/31 up/down ARISTA01T2 10.0.0.1 Ethernet4 10.0.0.2/31 up/down ARISTA02T2 10.0.0.3 Ethernet8 10.0.0.4/31 up/down ARISTA03T2 10.0.0.5 Ethernet12 10.0.0.6/31 up/down ARISTA04T2 10.0.0.7 Ethernet16 10.0.0.8/31 up/down ARISTA05T2 10.0.0.9

admin@sonic:~$ bcmcmd ps ena/ speed/ link auto STP lrn inter max cut loop port link Lns duplex scan neg? state pause discrd ops face frame thru? back encap ce0( 1) down 4 25G FD SW Yes Forward None F CAUI4 9122 No IEEE ce1( 5) down 4 25G FD SW Yes Forward None F CAUI4 9122 No IEEE ce2( 9) down 4 25G FD SW Yes Forward None F CAUI4 9122 No IEEE ce3( 13) down 4 25G FD SW Yes Forward None F CAUI4 9122 No IEEE

root@sonic:~# show interface autoneg status Interface Auto-Neg Mode Speed Adv Speeds Type Adv Types Oper Admin


Ethernet0 enabled 100G 100G N/A N/A down up Ethernet4 enabled 100G 100G N/A N/A down up Ethernet8 enabled 100G 100G N/A N/A down up Ethernet12 enabled 100G 100G N/A N/A down up Ethernet16 N/A 100G N/A N/A N/A down up Ethernet20 N/A 100G N/A N/A N/A down up

admin@sonic:~$ show muxcable cableinfo Ethernet4 Vendor Model


Credo CAC115321P2PA2MS admin@sonic:~$ show muxcable cableinfo Ethernet8 Vendor Model


Credo CAC12X321P2PA2MS admin@sonic:~$

Thanks & Regards, GAcharya

Staphylo commented 2 years ago

I investigated the issue after seeing the Gautam's email on the mailing list. This seems to be the same issue that happened on 201811 and 202012. @lguohan AFAICT this will require a SAI fix to enable AN/LT no FEC

zhangyanzhao commented 2 years ago

So far, this is only supported by 202012 release, failure is expected.

lguohan commented 2 years ago

an/lt with no fec is support on 202012 only for now. 202111 does not support an/lt with no fec.