search

sonic-net / SONiC

Landing page for Software for Open Networking in the Cloud (SONiC) - https://sonic-net.github.io/SONiC/
2.26k stars 1.13k forks source link

Can't get SONiC running on AG9064, what am I missing? #462

Open AeonJJohnson opened 5 years ago

AeonJJohnson commented 5 years ago

Greetings,

Posting here is a last resort. I have downloaded and installed two versions of sonic-broadcom.bin and installed them via ONIE into a new Delta AG9064.

All I need is L2/L3 as a single standalone switch, no upstream, no routing.

I am able to see the quad lane ports as discovered during install (Ethernet0, Ethernet4, etc). With cables plugged in I can see the eeprom data as well as interface status showing that a QSFP is connected to ports. Admin status is up. I have tried setting MTUs, configuring and adding ports to a vlan.

The links never go live. Attached 40GbE hosts and switches see a dead port, no link present. Used copper and optical cables.

I have followed several wiki procedures. I cannot seem to make this switch/SONiC do anything but consume power.

I had loaded the latest build. After reading a issue about docker containers stopping I loaded a July 28 build. Same thing, won't bring ports up.

What am I missing?

AeonJJohnson commented 5 years ago

The switch is partially there. It sees ports. Nothing passes traffic or goes link up.

root@switch-delta-00:/etc# show interfaces status
  Interface            Lanes    Speed    MTU         Alias    Vlan    Oper    Admin                    Type    Asym PFC
-----------  ---------------  -------  -----  ------------  ------  ------  -------  ----------------------  ----------
  Ethernet0      49,50,51,52      N/A   9100   Ethernet1/1   trunk     N/A       up  Unknown or unspecified         N/A
  Ethernet4      53,54,55,56      N/A   9100   Ethernet2/1   trunk     N/A       up          QSFP+ or later         N/A
  Ethernet8      65,66,67,68      N/A   9100   Ethernet3/1   trunk     N/A       up  Unknown or unspecified         N/A
 Ethernet12      69,70,71,72      N/A   9100   Ethernet4/1   trunk     N/A       up                     N/A         N/A
 Ethernet16      81,82,83,84      N/A   9100   Ethernet5/1   trunk     N/A       up                     N/A         N/A
 Ethernet20      85,86,87,88      N/A   9100   Ethernet6/1   trunk     N/A       up                     N/A         N/A
 Ethernet24          1,2,3,4      N/A   9100   Ethernet7/1  routed     N/A       up                     N/A         N/A
 Ethernet28  101,102,103,104      N/A   9100   Ethernet8/1  routed     N/A       up                     N/A         N/A
 Ethernet32          5,6,7,8      N/A   9100   Ethernet9/1  routed     N/A       up                     N/A         N/A
 Ethernet36      17,18,19,20      N/A   9100  Ethernet10/1  routed     N/A       up                     N/A         N/A
# show interfaces transceiver eeprom Ethernet4
Ethernet4: SFP EEPROM detected
        Connector: No separable connector
        Encoding: 64B66B
        Extended Identifier: Power Class 1(1.5W max)
        Extended RateSelect Compliance: QSFP+ Rate Select Version 1
        Identifier: QSFP+ or later
        Length Cable Assembly(m): 2
        Nominal Bit Rate(100Mbs): 141
        Specification compliance:
                10/40G Ethernet Compliance Code: 40GBASE-CR4
        Vendor Date Code(YYYY-MM-DD Lot): 2014-11-25
        Vendor Name: Mellanox
        Vendor OUI: 00-02-c9
        Vendor PN: MC2207130-002
        Vendor Rev: A3
        Vendor SN: MT1442VS09270
root@switch-delta-00:/etc# docker ps -a
CONTAINER ID        IMAGE                             COMMAND                  CREATED             STATUS                      PORTS               NAMES
17b4d93f3586        docker-dhcp-relay:latest          "/usr/bin/docker_ini…"   31 minutes ago      Exited (0) 29 minutes ago                       dhcp_relay
a2c80222002d        docker-syncd-brcm:latest          "/usr/bin/supervisord"   31 minutes ago      Up 25 minutes                                   syncd
d8be60bd89aa        docker-router-advertiser:latest   "/usr/bin/supervisord"   31 minutes ago      Up 25 minutes                                   radv
fc5664b15742        docker-teamd:latest               "/usr/bin/supervisord"   31 minutes ago      Up 28 minutes                                   teamd
fedb1640a1d0        docker-snmp-sv2:latest            "/usr/bin/supervisord"   31 minutes ago      Exited (0) 28 minutes ago                       snmp
3cf89da7ce55        docker-orchagent:latest           "/usr/bin/supervisord"   31 minutes ago      Up 1 second                                     swss
6b58342bf03c        docker-lldp-sv2:latest            "/usr/bin/supervisord"   32 minutes ago      Up 32 minutes                                   lldp
d451a60b9077        docker-fpm-frr:latest             "/usr/bin/supervisord"   32 minutes ago      Up 32 minutes                                   bgp
840bd472f9e0        docker-platform-monitor:latest    "/usr/bin/docker_ini…"   32 minutes ago      Up 32 minutes                                   pmon
a9e646e0b70e        docker-sonic-telemetry:latest     "/usr/bin/supervisord"   32 minutes ago      Up 32 minutes                                   telemetry
3b776204a76a        docker-database:latest            "/usr/bin/supervisord"   32 minutes ago      Up 32 minutes                                   database
root@switch-delta-00:/etc# show vlan brief
+-----------+--------------+------------+----------------+-----------------------+
|   VLAN ID | IP Address   | Ports      | Port Tagging   | DHCP Helper Address   |
+===========+==============+============+================+=======================+
|       100 |              | Ethernet0  | untagged       |                       |
|           |              | Ethernet4  | tagged         |                       |
|           |              | Ethernet8  | tagged         |                       |
|           |              | Ethernet12 | tagged         |                       |
|           |              | Ethernet16 | tagged         |                       |
|           |              | Ethernet20 | tagged         |                       |
+-----------+--------------+------------+----------------+-----------------------+
prsunny commented 5 years ago

can you paste the output of bcmcmd 'ps'

AeonJJohnson commented 5 years ago

Nothing...

admin@switch-delta-00:~$ bcmcmd 'ps'
polling socket timeout: Success
admin@switch-delta-00:~$ sudo bash
root@switch-delta-00:/home/admin# bcmcmd 'ps'
polling socket timeout: Success
geraldmyres commented 5 years ago

Have you tried to set the interface port speed ?

sudo config interface speed Ethernet0 40000

AeonJJohnson commented 5 years ago

Yes. Tried speed. Tried manually restarting stopped containers. I can read the cable eeproms, but the ports won’t link.

I’ll literally pay a bounty to get this switch running.

—Jeff

On Fri, Sep 13, 2019 at 08:49 geraldmyres notifications@github.com wrote:

Have you tried to set the interface port speed ?

sudo config interface speed Ethernet0 40000

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/Azure/SONiC/issues/462?email_source=notifications&email_token=AB7BTWHWOHNVMKE5BJ3QNJLQJOZA3A5CNFSM4IVPYPO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6VNVMI#issuecomment-531290801, or mute the thread https://github.com/notifications/unsubscribe-auth/AB7BTWERHJCZ7NN3BDLTTG3QJOZA3ANCNFSM4IVPYPOQ .

--

Jeff Johnson Co-Founder Aeon Computing

jeff.johnson@aeoncomputing.com www.aeoncomputing.com t: 858-412-3810 x1001 f: 858-412-3845 m: 619-204-9061

4170 Morena Boulevard, Suite C - San Diego, CA 92117

High-Performance Computing / Lustre Filesystems / Scale-out Storage

Aster-ZhangBen commented 5 years ago

verify the configuration of port in config_db.json, whether configure "fec:rs"