Closed bingwang-ms closed 3 years ago
Is it due to incorrect mmu setting? @lguohan ? Configs looks correct to me.
Can we check the queue counters on the interfaces that are seeing drops?
The queue counters are
admin@str2-7050cx3-acs-01:~$ show queue counters Ethernet4
Port TxQ Counter/pkts Counter/bytes Drop/pkts Drop/bytes
--------- ----- -------------- --------------- ----------- ------------
Ethernet4 UC0 419 78729 0 0
Ethernet4 UC1 1 126 0 0
Ethernet4 UC2 0 0 0 0
Ethernet4 UC3 0 0 0 0
Ethernet4 UC4 0 0 0 0
Ethernet4 UC5 0 0 0 0
Ethernet4 UC6 0 0 0 0
Ethernet4 UC7 0 0 0 0
Ethernet4 UC8 0 0 0 0
Ethernet4 UC9 0 0 0 0
Ethernet4 MC10 0 0 48 3072
Ethernet4 MC11 0 0 260 26992
Ethernet4 MC12 0 0 0 0
Ethernet4 MC13 0 0 0 0
Ethernet4 MC14 0 0 0 0
Ethernet4 MC15 0 0 0 0
Ethernet4 MC16 0 0 0 0
Ethernet4 MC17 0 0 0 0
Ethernet4 MC18 0 0 0 0
Ethernet4 MC19 0 0 0 0
admin@str2-7050cx3-acs-01:~$ show queue counters Ethernet8
Port TxQ Counter/pkts Counter/bytes Drop/pkts Drop/bytes
--------- ----- -------------- --------------- ----------- ------------
Ethernet8 UC0 436 80350 0 0
Ethernet8 UC1 1 126 0 0
Ethernet8 UC2 0 0 0 0
Ethernet8 UC3 0 0 0 0
Ethernet8 UC4 0 0 0 0
Ethernet8 UC5 0 0 0 0
Ethernet8 UC6 0 0 0 0
Ethernet8 UC7 0 0 0 0
Ethernet8 UC8 0 0 0 0
Ethernet8 UC9 0 0 0 0
Ethernet8 MC10 0 0 54 3456
Ethernet8 MC11 0 0 273 28182
Ethernet8 MC12 0 0 0 0
Ethernet8 MC13 0 0 0 0
Ethernet8 MC14 0 0 0 0
Ethernet8 MC15 0 0 0 0
Ethernet8 MC16 0 0 0 0
Ethernet8 MC17 0 0 0 0
Ethernet8 MC18 0 0 0 0
Ethernet8 MC19 0 0 0 0
admin@str2-7050cx3-acs-01:~$ show queue counters Ethernet68
Port TxQ Counter/pkts Counter/bytes Drop/pkts Drop/bytes
---------- ----- -------------- --------------- ----------- ------------
Ethernet68 UC0 437 81128 0 0
Ethernet68 UC1 1 126 0 0
Ethernet68 UC2 0 0 0 0
Ethernet68 UC3 0 0 0 0
Ethernet68 UC4 0 0 0 0
Ethernet68 UC5 0 0 0 0
Ethernet68 UC6 0 0 0 0
Ethernet68 UC7 0 0 0 0
Ethernet68 UC8 0 0 0 0
Ethernet68 UC9 0 0 0 0
Ethernet68 MC10 0 0 54 3456
Ethernet68 MC11 0 0 273 28182
Ethernet68 MC12 0 0 0 0
Ethernet68 MC13 0 0 0 0
Ethernet68 MC14 0 0 0 0
Ethernet68 MC15 0 0 0 0
Ethernet68 MC16 0 0 0 0
Ethernet68 MC17 0 0 0 0
Ethernet68 MC18 0 0 0 0
Ethernet68 MC19 0 0 0 0
admin@str2-7050cx3-acs-01:~$ show queue counters Ethernet96
Port TxQ Counter/pkts Counter/bytes Drop/pkts Drop/bytes
---------- ----- -------------- --------------- ----------- ------------
Ethernet96 UC0 436 81038 0 0
Ethernet96 UC1 1 126 0 0
Ethernet96 UC2 0 0 0 0
Ethernet96 UC3 0 0 0 0
Ethernet96 UC4 0 0 0 0
Ethernet96 UC5 0 0 0 0
Ethernet96 UC6 0 0 0 0
Ethernet96 UC7 0 0 0 0
Ethernet96 UC8 0 0 0 0
Ethernet96 UC9 0 0 0 0
Ethernet96 MC10 0 0 54 3456
Ethernet96 MC11 0 0 273 28182
Ethernet96 MC12 0 0 0 0
Ethernet96 MC13 0 0 0 0
Ethernet96 MC14 0 0 0 0
Ethernet96 MC15 0 0 0 0
Ethernet96 MC16 0 0 0 0
Ethernet96 MC17 0 0 0 0
Ethernet96 MC18 0 0 0 0
Ethernet96 MC19 0 0 0 0
admin@str2-7050cx3-acs-01:~$ show queue counters Ethernet120
Port TxQ Counter/pkts Counter/bytes Drop/pkts Drop/bytes
----------- ----- -------------- --------------- ----------- ------------
Ethernet120 UC0 11978 2032524 0 0
Ethernet120 UC1 1 126 0 0
Ethernet120 UC2 0 0 0 0
Ethernet120 UC3 0 0 0 0
Ethernet120 UC4 0 0 0 0
Ethernet120 UC5 0 0 0 0
Ethernet120 UC6 0 0 0 0
Ethernet120 UC7 0 0 0 0
Ethernet120 UC8 0 0 0 0
Ethernet120 UC9 0 0 0 0
Ethernet120 MC10 0 0 26 1664
Ethernet120 MC11 0 0 243 25468
Ethernet120 MC12 0 0 0 0
Ethernet120 MC13 0 0 0 0
Ethernet120 MC14 0 0 0 0
Ethernet120 MC15 0 0 0 0
Ethernet120 MC16 0 0 0 0
Ethernet120 MC17 0 0 0 0
Ethernet120 MC18 0 0 0 0
Ethernet120 MC19 0 0 0 0
Description The test case
test_vlan
is consistently failing on 7050cx3. I did some investigation and found that packets are dropped on egress side. Test casetest_vlan
do following things:Ethernet112
)However, I found that packets are dropped on DUT at egress side.
To make it more obvious, I injected 100 packets into
Ethernet112
and we can see that all packets were dropped at all vlan interfaces tx. Test plan https://github.com/Azure/sonic-mgmt/blob/662511e2f95cd873e92af9898a1c05aede0d4dab/docs/testplan/VLAN-trunk-test-plan.mdSteps to reproduce the issue:
test_vlan
Describe the results you received: The test case should pass.
Describe the results you expected: Test case failed because packets are dropped.
Additional information you deem important (e.g. issue happens only occasionally):