search

sonic-net / sonic-utilities

Command line utilities for the SONiC project
Other
152 stars 650 forks source link

Error messages with Unaccounted_ROUTE_ENTRY_TABLE_entries make many tests failing #1072

Open vsenchyshyn opened 4 years ago

vsenchyshyn commented 4 years ago

Description The route_check is not ready for the IPv4/v6 default routes created by RouteOrch in ASIC_DB only. As a result it always throws errors making many tests failing due to log analyzer.

Errors in syslog:

Aug 25 14:48:14.913952 cab18-1-dut ERR route_check.py:  results: { {#012    "Unaccounted_ROUTE_ENTRY_TABLE_entries": [#012        "0.0.0.0/0", #012        "::/0"#012    ]#012} }
Aug 25 14:49:14.859304 cab18-1-dut ERR monit[560]: 'routeCheck' status failed (255) -- results: { {#012    "Unaccounted_ROUTE_ENTRY_TABLE_entries": [#012        "0.0.0.0/0", #012        "::/0"#012    ]#012} }#012 Failed. Look at reported mismatches above

Test fail log:

>           raise LogAnalyzerError(result)
E           LogAnalyzerError: {'match_messages': {'/tmp/syslog.2020-08-25-06:14:30': ['Aug 25 14:33:14.236726 cab18-1-dut ERR route_check.py:  results: { {#012    "Unaccounted_ROUTE_ENTRY_TABLE_entries": [#012        "0.0.0.0/0", #012        "::/0"#012    ]#012} }\n', 'Aug 25 14:33:14.236965 cab18-1-dut ERR route_check.py:  Failed. Look at reported mismatches above\n']}, 'total': {'expected_match': 0, 'expected_missing_match': 0, 'match': 2}, 'match_files': {'/tmp/syslog.2020-08-25-06:14:30': {'expected_match': 0, 'match': 2}}, 'expect_messages': {'/tmp/syslog.2020-08-25-06:14:30': []}, 'unused_expected_regexp': []}

common/plugins/loganalyzer/loganalyzer.py:85: LogAnalyzerError

Steps to reproduce the issue

  1. Run copp or fdb test.

Describe the results you received

Describe the results you expected

Additional information you deem important (e.g. issue happens only occasionally)

Output of show version

SONiC Software Version: SONiC.HEAD.745-dirty-20200818.045824
Distribution: Debian 10.5
Kernel: 4.19.0-9-2-amd64
Build commit: 4487abdf
Build date: Tue Aug 18 14:29:24 UTC 2020
Built by: johnar@jenkins-worker-4

Platform: x86_64-accton_wedge100bf_32x-r0
HwSKU: montara
ASIC: barefoot
Serial Number: AI01016184
Uptime: 16:41:18 up  1:46,  1 user,  load average: 1.20, 1.08, 0.86

Docker images:
REPOSITORY                    TAG                              IMAGE ID            SIZE
docker-teamd                  HEAD.745-dirty-20200818.045824   e9726da98828        380MB
docker-teamd                  latest                           e9726da98828        380MB
docker-nat                    HEAD.745-dirty-20200818.045824   b7cc20e288a3        383MB
docker-nat                    latest                           b7cc20e288a3        383MB
docker-router-advertiser      HEAD.745-dirty-20200818.045824   30fa52c42aed        351MB
docker-router-advertiser      latest                           30fa52c42aed        351MB
docker-platform-monitor       HEAD.745-dirty-20200818.045824   7d8f9274e425        423MB
docker-platform-monitor       latest                           7d8f9274e425        423MB
docker-lldp                   HEAD.745-dirty-20200818.045824   ed20fdbf758b        377MB
docker-lldp                   latest                           ed20fdbf758b        377MB
docker-dhcp-relay             HEAD.745-dirty-20200818.045824   cffa0d68492b        358MB
docker-dhcp-relay             latest                           cffa0d68492b        358MB
docker-database               HEAD.745-dirty-20200818.045824   6fc8176b10be        351MB
docker-database               latest                           6fc8176b10be        351MB
docker-orchagent              HEAD.745-dirty-20200818.045824   f37a9ec25736        394MB
docker-orchagent              latest                           f37a9ec25736        394MB
docker-sonic-telemetry        HEAD.745-dirty-20200818.045824   1f6c85710528        420MB
docker-sonic-telemetry        latest                           1f6c85710528        420MB
docker-sonic-mgmt-framework   HEAD.745-dirty-20200818.045824   d84da70752c7        476MB
docker-sonic-mgmt-framework   latest                           d84da70752c7        476MB
docker-fpm-frr                HEAD.745-dirty-20200818.045824   3dde5a8f8de2        396MB
docker-fpm-frr                latest                           3dde5a8f8de2        396MB
docker-sflow                  HEAD.745-dirty-20200818.045824   d3294ab3d44d        384MB
docker-sflow                  latest                           d3294ab3d44d        384MB
docker-snmp                   HEAD.745-dirty-20200818.045824   52e5d89f813f        391MB
docker-snmp                   latest                           52e5d89f813f        391MB
docker-syncd-bfn              HEAD.745-dirty-20200818.045824   c138b31b9a34        2.43GB
docker-syncd-bfn              latest
prsunny commented 4 years ago

Typically we run the copp/fdb test with bgp sessions established and that way default route is always present in APP_DB. May be you should run the test with bgp sessions.