search

sonic-net / sonic-buildimage

Scripts which perform an installable binary image build for SONiC
Other
736 stars 1.42k forks source link

[SONiC 201911][BRCM TD3][QoS] Port went down after applying QoS config #4643

Open CLUDev opened 4 years ago

CLUDev commented 4 years ago

Description

Port status went down after applying QoS configuration SONiC: 201911 BRCM SAI: 4.1.1.7

Steps to reproduce the issue:

  1. Config port and connect DAC cable to make sure port status is "up" Check port status: root@sonic:/etc/sonic# show interfaces status | grep net16 Ethernet16 29 25G 9100 Ethernet16 routed up up SFP/SFP+/SFP28 N/A

  2. Apply QoS config root@sonic:# config qos reload root@sonic:# config save -y

  3. Check port status root@sonic:/etc/sonic# show interfaces status | grep net16 Ethernet16 29 25G 9100 Ethernet16 routed down up SFP/SFP+/SFP28 N/A

Describe the results you received: root@sonic:/etc/sonic# show interfaces status | grep net16 Ethernet16 29 25G 9100 Ethernet16 routed down up SFP/SFP+/SFP28 N/A

Describe the results you expected: root@sonic:/etc/sonic# show interfaces status | grep net16 Ethernet16 29 25G 9100 Ethernet16 routed up up SFP/SFP+/SFP28 N/A

Additional information you deem important (e.g. issue happens only occasionally):

**Output of `show version`:**

```
root@sonic:~# show version
SONiC Software Version: SONiC.Inventec-201911.0-dirty-20200319.145423
Distribution: Debian 9.12
Kernel: 4.9.0-9-2-amd64
```

**Attach debug file `sudo generate_dump`:**

```
root@sonic:~# generate_dump

tar: sonic_dump_sonic_20200526_121038/etc/rc0.d/K01docker: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/rc1.d/K01docker: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/rc2.d/S01docker: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/rc3.d/S01docker: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/rc4.d/S01docker: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/rc5.d/S01docker: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/rc6.d/K01docker: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/fancontrol.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/platform-modules-dx010.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/platform-modules-haliburton.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/platform-modules-s5232f.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/platform-modules-s5248f.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/platform-modules-s6000.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/platform-modules-s6100.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/platform-modules-silverstone.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/platform-modules-z9100.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/platform-modules-z9264f.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/qfx5210-platform-init.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/s6100-lpc-monitor.service: File removed before we read it tar: sonic_dump_sonic_20200526_121038/etc/systemd/system/multi-user.target.wants/z9100-lpc-monitor.service: File removed before we read it Tar append operation failed. Aborting for safety. /var/dump/sonic_dump_sonic_20200526_121038.tar.gz

```

Syslog Error Messages

May 26 12:10:05.504064 sonic ERR syncd#syncd: __brcm_xgs_sai_port_ing_tc_map_set:3885 qos map type get failed with error Entry not found (0xfffffff9).
May 26 12:10:05.504064 sonic ERR syncd#syncd: _brcm_xgs_sai_port_dscp_tc_map_set:2998 dscp map set failed with error Entry not found (0xfffffff9).
May 26 12:10:05.504064 sonic ERR syncd#syncd: brcm_sai_set_port_attribute:598 Set port 1 attrib 1 failed with error 0xfffffff9.
May 26 12:10:05.504099 sonic ERR syncd#syncd: :- processEvent: VID: oid:0x1000000000002 RID: oid:0x100000001
May 26 12:10:05.504121 sonic ERR syncd#syncd: :- processEvent: attr: SAI_PORT_ATTR_QOS_DSCP_TO_TC_MAP: oid:0x14000000000a0d
May 26 12:10:05.504121 sonic ERR syncd#syncd: :- processEvent: failed to execute api: set, key: SAI_OBJECT_TYPE_PORT:oid:0x1000000000002, status: SAI_STATUS_ITEM_NOT_FOUND
May 26 12:10:05.504140 sonic ERR syncd#syncd: :- syncd_main: Runtime error: :- processEvent: failed to execute api: set, key: SAI_OBJECT_TYPE_PORT:oid:0x1000000000002, status: SAI_STATUS_ITEM_NOT_FOUND
May 26 12:10:05.504154 sonic NOTICE syncd#syncd: :- notify_OA_about_syncd_exception: sending switch_shutdown_request notification to OA
May 26 12:10:05.504170 sonic NOTICE syncd#syncd: :- notify_OA_about_syncd_exception: notification send successfull
May 26 12:10:05.504312 sonic NOTICE swss#orchagent: :- handle_switch_shutdown_request: switch shutdown request
lguohan commented 4 years ago

this is a private build and the SAI version is not released yet.