sonic-net / sonic-buildimage

Scripts which perform an installable binary image build for SONiC
Other
730 stars 1.4k forks source link

Error log found when trying to flush fdb during the test_vnet_vxlan #6036

Open stephenxs opened 3 years ago

stephenxs commented 3 years ago

Description Error log found when trying to flush fdb during the test_vnet_vxlan

Nov 25 07:06:34.479307 mtbc-sonic-03-2700 ERR syncd#SDK: :- redisPutFdbEntryToAsicView: received a flush port fdb event, port_oid = 0x3a0000000005af, bv_id = 0x0, unsupported
Nov 25 07:06:34.495329 mtbc-sonic-03-2700 ERR swss#orchagent: :- update: FdbOrch notification: not supported flush port fdb action, port_id = 0x3a0000000005af, bv_id = 0x0.

the port id is the bridge port:

admin@mtbc-sonic-03-2700:~$ redis-cli -n 1
127.0.0.1:6379[1]> keys *3a0000000005af*
1) "ASIC_STATE:SAI_OBJECT_TYPE_BRIDGE_PORT:oid:0x3a0000000005af"
127.0.0.1:6379[1]> 

Steps to reproduce the issue:

  1. execute test_vnet_vxlan

Describe the results you received: There are error logs

Describe the results you expected: There should not be error log.

Additional information you deem important (e.g. issue happens only occasionally):

**Output of `show version`:**
admin@mtbc-sonic-03-2700:~$ show version

SONiC Software Version: SONiC.201911.30-dirty-20201124.120644
Distribution: Debian 9.13
Kernel: 4.9.0-11-2-amd64
Build commit: ac5117f2
Build date: Tue Nov 24 11:57:24 UTC 2020
Built by: sw-r2d2-bot@r-build-sonic-ci02

Platform: x86_64-mlnx_msn2700-r0
HwSKU: ACS-MSN2700
ASIC: mellanox
Serial Number: MT1844K07863
Uptime: 10:17:18 up  9:34,  1 user,  load average: 0.92, 2.14, 2.63

Docker images:
REPOSITORY                    TAG                               IMAGE ID            SIZE
docker-syncd-mlnx             201911.30-dirty-20201124.120644   e758fd3a3240        399MB
docker-syncd-mlnx             latest                            e758fd3a3240        399MB
docker-sonic-telemetry        201911.30-dirty-20201124.120644   4354e24f368d        353MB
docker-sonic-telemetry        latest                            4354e24f368d        353MB
docker-router-advertiser      201911.30-dirty-20201124.120644   74d4310804b7        290MB
docker-router-advertiser      latest                            74d4310804b7        290MB
docker-platform-monitor       201911.30-dirty-20201124.120644   2904669937a5        665MB
docker-platform-monitor       latest                            2904669937a5        665MB
docker-fpm-frr                201911.30-dirty-20201124.120644   804893596a66        335MB
docker-fpm-frr                latest                            804893596a66        335MB
docker-teamd                  201911.30-dirty-20201124.120644   43862681ed22        315MB
docker-teamd                  latest                            43862681ed22        315MB
docker-lldp-sv2               201911.30-dirty-20201124.120644   96bf1ad6f224        312MB
docker-lldp-sv2               latest                            96bf1ad6f224        312MB
docker-dhcp-relay             201911.30-dirty-20201124.120644   90aa45d7faf6        300MB
docker-dhcp-relay             latest                            90aa45d7faf6        300MB
docker-database               201911.30-dirty-20201124.120644   eaac4565aec3        289MB
docker-database               latest                            eaac4565aec3        289MB
docker-snmp-sv2               201911.30-dirty-20201124.120644   4046aec714f3        348MB
docker-snmp-sv2               latest                            4046aec714f3        348MB
docker-orchagent              201911.30-dirty-20201124.120644   7bb60251023b        333MB
docker-orchagent              latest                            7bb60251023b        333MB
docker-sflow                  201911.30-dirty-20201124.120644   40dcd66b4af4        315MB
docker-sflow                  latest                            40dcd66b4af4        315MB
docker-nat                    201911.30-dirty-20201124.120644   40757ed6bbfb        316MB
docker-nat                    latest                            40757ed6bbfb        316MB
docker-sonic-mgmt-framework   201911.30-dirty-20201124.120644   354cc3e4d510        427MB
docker-sonic-mgmt-framework   latest                            354cc3e4d510        427MB
**Attach debug file `sudo generate_dump`:**

sonic_dump_mtbc-sonic-03-2700_20201125_063053.tar.gz

    (paste your output here)
anshuv-mfst commented 3 years ago

Might be related to https://github.com/Azure/sonic-swss/commit/756dd9c8123cd06dc581d9b2eb236334deee1850

anshuv-mfst commented 3 years ago

@madhanmellanox - can you please look into this issue.

madhanmellanox commented 3 years ago

@anshuv-msft my fix introduced flush the FDB entries while removing bridgeport only. This is Flush FDB request from SDK. How is it related?

madhanmellanox commented 3 years ago

@prsunny do you think this is the side effect of flushFDBentries() fix while removing bridgeport. I see Flush FDB entries request coming from SDK here. How is this issue related to my fix?

madhanmellanox commented 3 years ago

@stephenxs the showtech does not contain the error logs you pointed out.

madhanmellanox commented 3 years ago

Working on the fix, the issue happens when we try to remove a VLAN member.

madhanmellanox commented 3 years ago

@prsunny When I was trying to modify function redisPutFdbEntryToAsicView() in sonic-sairedis, I did not find Redisclient.cpp and so no member function processFlushEvent(). Not sure how to handle this.

kcudnik commented 3 years ago

depends which Redisclient.cpp, since there was one in swss-common (which was merged with dbconnector) and there is RedisClient.cpp on master now, but not 201119