sonic-net / sonic-buildimage

Scripts which perform an installable binary image build for SONiC
Other
736 stars 1.42k forks source link

ZMQbg core getting generated while running sonic PTF #19948

Open kaushiksrivatsav opened 2 months ago

kaushiksrivatsav commented 2 months ago

Description

'ZMQbg!IO!0.1723726688.21.core.gz' core files getting genrated while running SONIC PTF we  cross referenced the timing of crash to telemetry test cases.

Steps to reproduce the issue:

  1. RUN SONIC PTF FULL SUIT
  2. check for crashes on the DUT

Describe the results you received:

root@DUT-1:/var/core# ls -ltr total 5160 -rw-r--r-- 1 root root 5282778 Aug 15 12:58 'ZMQbg!IO!0.1723726688.21.core.gz'

Describe the results you expected:

NO crashes expected

Output of show version:

SONiC Software Version: SONiC.202405.0-dirty-20240730.123718
SONiC OS Version: 12
Distribution: Debian 12.5
Kernel: 6.1.0-11-2-arm64
Build commit: aa41c758c
Build date: Tue Jul 30 12:38:01 UTC 2024
Built by: marvell@cpss-arm-vm03

Platform: arm64-marvell_rd98DX35xx_cn9131-r0
HwSKU: rd98DX35xx_cn9131
ASIC: marvell
ASIC Count: 1
Serial Number: NA
Model Number: NA
Hardware Revision: N/A
Uptime: 15:56:34 up 3 days,  2:30,  2 users,  load average: 0.73, 0.61, 0.56
Date: Mon 19 Aug 2024 15:56:34

Docker images:
REPOSITORY                    TAG                              IMAGE ID       SIZE
docker-syncd-mrvl-rpc         202405.0-dirty-20240730.123718   67b05663cf7a   635MB
docker-syncd-mrvl-rpc         latest                           67b05663cf7a   635MB
docker-macsec                 latest                           bd26712bdd58   515MB
docker-dhcp-relay             latest                           ec31ee4f9668   494MB
docker-teamd                  202405.0-dirty-20240730.123718   24bc142b14e8   512MB
docker-teamd                  latest                           24bc142b14e8   512MB
docker-sonic-mgmt-framework   202405.0-dirty-20240730.123718   d3002a58718a   530MB
docker-sonic-mgmt-framework   latest                           d3002a58718a   530MB
docker-snmp                   202405.0-dirty-20240730.123718   7567f4e5fb13   525MB
docker-snmp                   latest                           7567f4e5fb13   525MB
docker-sflow                  202405.0-dirty-20240730.123718   8ff35382ffd6   513MB
docker-sflow                  latest                           8ff35382ffd6   513MB
docker-router-advertiser      202405.0-dirty-20240730.123718   fd4585a6eb3b   484MB
docker-router-advertiser      latest                           fd4585a6eb3b   484MB
docker-platform-monitor       202405.0-dirty-20240730.123718   f26f018d0500   839MB
docker-platform-monitor       latest                           f26f018d0500   839MB
docker-orchagent              202405.0-dirty-20240730.123718   d8239b5bef47   526MB
docker-orchagent              latest                           d8239b5bef47   526MB
docker-nat                    202405.0-dirty-20240730.123718   0b8c0af8c33b   521MB
docker-nat                    latest                           0b8c0af8c33b   521MB
docker-mux                    202405.0-dirty-20240730.123718   44fc738e1241   499MB
docker-mux                    latest                           44fc738e1241   499MB
docker-lldp                   202405.0-dirty-20240730.123718   a0eae43277b7   491MB
docker-lldp                   latest                           a0eae43277b7   491MB
docker-sonic-gnmi             202405.0-dirty-20240730.123718   ee8dae4d8c76   565MB
docker-sonic-gnmi             latest                           ee8dae4d8c76   565MB
docker-fpm-frr                202405.0-dirty-20240730.123718   1863630daa32   545MB
docker-fpm-frr                latest                           1863630daa32   545MB
docker-eventd                 202405.0-dirty-20240730.123718   2ff7fe50df5c   484MB
docker-eventd                 latest                           2ff7fe50df5c   484MB
docker-database               202405.0-dirty-20240730.123718   f64b2534d932   492MB
docker-database               latest                           f64b2534d932   492MB

Output of show techsupport:

[ZMQ_tech_support.zip](https://github.com/user-attachments/files/16662867/ZMQ_tech_support.zip)

Additional information you deem important (e.g. issue happens only occasionally):

gechiang commented 2 months ago

@matiAlfaro please help take a look. Thanks!