Closed ChinaMobileNG closed 3 years ago
Nov 8 03:53:59.814170 sonic INFO config: 'reload' executing...
Nov 8 03:53:59.815413 sonic INFO config: delete portstat data to ready for next time
Nov 8 03:53:59.821690 sonic INFO config: 'reload' stopping services...
Nov 8 03:53:59.840413 sonic INFO systemd[1]: Stopping WEB SERVER container...
Nov 8 03:54:01.131465 sonic INFO containerd[429]: time="2020-11-08T03:54:01.131272874Z" level=info msg="shim reaped" id=bbf39004fe6bebdbec59655ede01c5010a2612ee61f549f2eaa4118572c8c467
Nov 8 03:54:01.141937 sonic INFO dockerd[625]: time="2020-11-08T03:54:01.141691364Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="events.TaskDelete"
Nov 8 03:54:01.298540 sonic INFO web-server.sh[9571]: web-server
Nov 8 03:54:01.311547 sonic INFO systemd[1]: Stopped WEB SERVER container.
Nov 8 03:54:01.330968 sonic INFO systemd[1]: Stopping Neighbor proxy container...
Nov 8 03:54:01.331983 sonic INFO systemd[1]: Stopping SLAD container...
Nov 8 03:54:01.356610 sonic INFO systemd[1]: Stopping MSTPD container...
Nov 8 03:54:01.360422 sonic INFO systemd[1]: Stopping sFlow container...
Nov 8 03:54:01.363140 sonic INFO systemd[1]: Stopping Service providing "What-Just-Happened" feature functionality...
Nov 8 03:54:01.364634 sonic INFO systemd[1]: Stopping Management Framework container...
Nov 8 03:54:01.367003 sonic INFO systemd[1]: Stopping ICCPD container...
Nov 8 03:54:01.789022 sonic NOTICE wjhd: :- signalHandler: Caught SIGTERM, exiting ...
Nov 8 03:54:01.867688 sonic INFO proxy#supervisord: ndppd (error) Shutting down...
Nov 8 03:54:01.867688 sonic INFO proxy#supervisord: ndppd (notice) Bye
Nov 8 03:54:01.984496 sonic INFO containerd[429]: time="2020-11-08T03:54:01.984237817Z" level=info msg="shim reaped" id=6f5ad09c501d7370a43154debb372b659411a789357beea7aa31e403ba1a6704
Nov 8 03:54:01.993986 sonic INFO dockerd[625]: time="2020-11-08T03:54:01.993807619Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="events.TaskDelete"
Nov 8 03:54:02.092298 sonic INFO containerd[429]: time="2020-11-08T03:54:02.090560113Z" level=info msg="shim reaped" id=1229bce00906aa243644dea9106e7cab9ed4546ee1953af5a006089e8b193184
Nov 8 03:54:02.100676 sonic INFO dockerd[625]: time="2020-11-08T03:54:02.100471819Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="events.TaskDelete"
Nov 8 03:54:02.246373 sonic INFO mgmt-framework.sh[9619]: mgmt-framework
Nov 8 03:54:02.247393 sonic INFO mgmt-framework.sh[7073]: 0
Nov 8 03:54:02.258817 sonic INFO systemd[1]: Stopped Management Framework container.
Nov 8 03:54:02.288128 sonic INFO slad.sh[9613]: slad
Nov 8 03:54:02.289183 sonic INFO slad.sh[4479]: 0
Nov 8 03:54:02.299261 sonic INFO systemd[1]: Stopped SLAD container.
Nov 8 03:54:02.422834 sonic INFO iccpd#supervisord 2020-11-08 03:54:01,855 WARN received SIGTERM indicating exit request
Nov 8 03:54:02.422834 sonic INFO iccpd#supervisord 2020-11-08 03:54:01,855 INFO waiting for iccpd, rsyslogd, mclagmgrd to die
Nov 8 03:54:02.422834 sonic INFO iccpd#supervisord 2020-11-08 03:54:01,856 INFO stopped: mclagmgrd (terminated by SIGTERM)
Nov 8 03:54:02.796212 sonic NOTICE wjhd: :- deleteDropGroupReason: Drop group reason L2 unbound from channel forwarding
Nov 8 03:54:02.811018 sonic NOTICE wjhd: :- deleteDropGroupReason: Drop group reason L3 unbound from channel forwarding
Nov 8 03:54:02.814067 sonic NOTICE wjhd: :- deleteDropGroupReason: Drop group reason TUNNEL unbound from channel forwarding
Nov 8 03:54:03.105813 sonic INFO containerd[429]: time="2020-11-08T03:54:03.105271272Z" level=info msg="shim reaped" id=76ef5f92ccd35e402597a7418b9841fb9c7013588fc2be5bcb623bf85ccefd84
Nov 8 03:54:03.115654 sonic INFO dockerd[625]: time="2020-11-08T03:54:03.115467682Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="events.TaskDelete"
Nov 8 03:54:03.157800 sonic INFO containerd[429]: time="2020-11-08T03:54:03.157314181Z" level=info msg="shim reaped" id=f1ef1c3578e4434dee5241c479a87f410c40af0ec8da6f06c62a1ffc09ed6370
Nov 8 03:54:03.169817 sonic INFO dockerd[625]: time="2020-11-08T03:54:03.169377865Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="events.TaskDelete"
Nov 8 03:54:03.216804 sonic INFO containerd[429]: time="2020-11-08T03:54:03.216611218Z" level=info msg="shim reaped" id=d3f76f0c8876dd87794fc8c9944b3accd93f343fdc50732653ff0676589f18cd
Nov 8 03:54:03.229138 sonic INFO dockerd[625]: time="2020-11-08T03:54:03.228919981Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="events.TaskDelete"
Nov 8 03:54:03.381310 sonic INFO mstpd.sh[9614]: mstpd
Nov 8 03:54:03.382077 sonic INFO mstpd.sh[4408]: 0
Nov 8 03:54:03.384961 sonic INFO systemd[1]: Stopped MSTPD container.
Nov 8 03:54:03.424975 sonic INFO proxy.sh[9612]: proxy
Nov 8 03:54:03.425703 sonic INFO proxy.sh[4895]: 0
Nov 8 03:54:03.433981 sonic INFO systemd[1]: Stopped Neighbor proxy container.
Nov 8 03:54:03.453401 sonic INFO sflow.sh[7179]: 0
Nov 8 03:54:03.454192 sonic INFO sflow.sh[9615]: sflow
Nov 8 03:54:03.462190 sonic INFO systemd[1]: Stopped sFlow container.
Nov 8 03:54:04.283206 sonic INFO containerd[429]: time="2020-11-08T03:54:04.283017825Z" level=info msg="shim reaped" id=43e4f8255776c9b348f0155ab336942e5c344a2f5433f4959e4146aee4e24437
Nov 8 03:54:04.294189 sonic INFO dockerd[625]: time="2020-11-08T03:54:04.293322644Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="events.TaskDelete"
Nov 8 03:54:04.469219 sonic INFO what-just-happened.sh[6407]: 0
Nov 8 03:54:04.473957 sonic INFO what-just-happened.sh[9616]: what-just-happened
Nov 8 03:54:04.484108 sonic INFO systemd[1]: Stopped Service providing "What-Just-Happened" feature functionality.
Nov 8 03:54:11.860414 sonic INFO dockerd[625]: time="2020-11-08T03:54:11.860230270Z" level=info msg="Container b0b91a6b883acd35f67814b6ef8e6a69d10cd8fe450347cf1c82dbad5b0bc130 failed to exit within 10 seconds of signal 15 - using the force"
Nov 8 03:54:12.003120 sonic INFO containerd[429]: time="2020-11-08T03:54:12.002925259Z" level=info msg="shim reaped" id=b0b91a6b883acd35f67814b6ef8e6a69d10cd8fe450347cf1c82dbad5b0bc130
Nov 8 03:54:12.013849 sonic INFO dockerd[625]: time="2020-11-08T03:54:12.013676553Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="events.TaskDelete"
Nov 8 03:54:12.174421 sonic INFO iccpd.sh[4470]: 137
Nov 8 03:54:12.175478 sonic INFO iccpd.sh[9620]: iccpd
Nov 8 03:54:12.191808 sonic INFO systemd[1]: Stopped ICCPD container.
Nov 8 03:54:12.195581 sonic INFO systemd[1]: Stopping switch state service...
Nov 8 03:54:12.200578 sonic NOTICE root: Stopping swss service...
Nov 8 03:54:12.207703 sonic NOTICE root: Locking /tmp/swss-syncd-lock from swss service
Nov 8 03:54:12.216256 sonic NOTICE root: Locked /tmp/swss-syncd-lock (10) from swss service
Nov 8 03:54:12.431003 sonic NOTICE root: Warm boot flag: swss false.
Nov 8 03:54:15.718986 sonic INFO containerd[429]: time="2020-11-08T03:54:15.718789106Z" level=info msg="shim reaped" id=5342eac6512458a802346498e05de8fea2155bf6bddf3bcb38764a93cfa7e141
Nov 8 03:54:15.731300 sonic INFO dockerd[625]: time="2020-11-08T03:54:15.731072548Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="events.TaskDelete"
Nov 8 03:54:15.878204 sonic INFO swss.sh[3489]: No longer waiting on container 'swss'
Nov 8 03:54:15.878977 sonic INFO swss.sh[9960]: swss
Nov 8 03:54:15.889810 sonic NOTICE root: Stopped swss service...
Nov 8 03:54:15.898475 sonic NOTICE root: Clearing FAST_REBOOT flag...
Nov 8 03:54:16.012520 sonic NOTICE root: Unlocking /tmp/swss-syncd-lock (10) from swss service
Nov 8 03:54:16.029034 sonic INFO systemd[1]: Stopping syncd service...
Nov 8 03:54:16.034562 sonic NOTICE root: Stopping syncd service...
Nov 8 03:54:16.046550 sonic NOTICE root: Locking /tmp/swss-syncd-lock from syncd service
Nov 8 03:54:16.055218 sonic NOTICE root: Locked /tmp/swss-syncd-lock (10) from syncd service
Nov 8 03:54:16.270244 sonic NOTICE root: Warm boot flag: syncd false.
Nov 8 03:54:16.276636 sonic NOTICE root: Stopping pmon service ahead of syncd...
Nov 8 03:54:16.287209 sonic INFO systemd[1]: Stopping Platform monitor container...
Nov 8 03:54:19.370242 sonic INFO pmon#syseepromd: Caught SIGTERM - exiting...
Nov 8 03:54:19.370614 sonic INFO pmon#syseepromd: Stop daemon main loop
Nov 8 03:54:19.373997 sonic INFO pmon#syseepromd: Shutting down...
Nov 8 03:54:20.398204 sonic INFO pmon#supervisord 2020-11-08 03:54:16,365 WARN received SIGTERM indicating exit request
Nov 8 03:54:20.398204 sonic INFO pmon#supervisord 2020-11-08 03:54:16,365 INFO waiting for transceiverd, syseepromd, supervisor-proc-exit-listener, rsyslogd to die
Nov 8 03:54:20.398204 sonic INFO pmon#supervisord 2020-11-08 03:54:19,369 INFO waiting for transceiverd, syseepromd, supervisor-proc-exit-listener, rsyslogd to die
Nov 8 03:54:20.398204 sonic INFO pmon#supervisord 2020-11-08 03:54:19,413 INFO stopped: syseepromd (exit status 0)
Nov 8 03:54:20.416397 sonic INFO pmon#transceiverd: Caught SIGTERM - exiting...
Nov 8 03:54:21.388438 sonic INFO pmon#transceiverd: Stop daemon main loop
Nov 8 03:54:21.393704 sonic INFO pmon#transceiverd: Shutting down...
Nov 8 03:54:24.549787 sonic INFO containerd[429]: time="2020-11-08T03:54:24.549585509Z" level=info msg="shim reaped" id=e669d02b8fa5744b3373fb072cc2e797e3969406812e13941b87daa7444660be
Nov 8 03:54:24.560195 sonic INFO dockerd[625]: time="2020-11-08T03:54:24.559988004Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="events.TaskDelete"
Nov 8 03:54:24.694016 sonic INFO pmon.sh[10048]: pmon
Nov 8 03:54:24.694782 sonic INFO pmon.sh[7249]: 0
Nov 8 03:54:24.702552 sonic INFO systemd[1]: Stopped Platform monitor container.
Nov 8 03:54:24.708621 sonic NOTICE root: Stopped pmon service
Nov 8 03:54:24.877554 sonic INFO syncd#supervisord: syncd Nov 08 03:54:24 ERROR SX_API_INTERNAL: Failed command read at communication channel: Connection reset by peer
Nov 8 03:54:26.042305 sonic INFO containerd[429]: time="2020-11-08T03:54:26.042115449Z" level=info msg="shim reaped" id=dcb0f43f2b627308b9f7f1164b4b9b97fcf202308449868cb522945f12f90c35
Nov 8 03:54:26.053864 sonic INFO dockerd[625]: time="2020-11-08T03:54:26.053680272Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Nov 8 03:54:26.196790 sonic INFO syncd.sh[10023]: syncd
Nov 8 03:54:26.197636 sonic INFO syncd.sh[6129]: 0
Nov 8 03:54:26.206748 sonic NOTICE root: Stopped syncd service...
Nov 8 03:54:26.262111 sonic DEBUG kernel: [ 180.645944] Kernel BFD start deinit
Nov 8 03:54:26.262140 sonic DEBUG kernel: [ 180.645948] BFD char-device deinitialized.
Nov 8 03:54:26.262143 sonic DEBUG kernel: [ 180.646114] Kernel BFD deinitialized
Nov 8 03:54:26.310337 sonic INFO kernel: [ 180.696576] sx_netdev: sx_netdev_cleanup
Nov 8 03:54:26.310366 sonic INFO kernel: [ 180.696598] sx_netdev: sx_netdev_dellink: called for Ethernet0
Nov 8 03:54:26.310369 sonic INFO kernel: [ 180.696617] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310371 sonic INFO kernel: [ 180.696618] sx_netdev: sx_netdev_dellink: called for Ethernet4
Nov 8 03:54:26.310373 sonic INFO kernel: [ 180.696623] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310374 sonic INFO kernel: [ 180.696624] sx_netdev: sx_netdev_dellink: called for Ethernet8
Nov 8 03:54:26.310376 sonic INFO kernel: [ 180.696629] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310378 sonic INFO kernel: [ 180.696630] sx_netdev: sx_netdev_dellink: called for Ethernet12
Nov 8 03:54:26.310379 sonic INFO kernel: [ 180.696634] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310381 sonic INFO kernel: [ 180.696635] sx_netdev: sx_netdev_dellink: called for Ethernet16
Nov 8 03:54:26.310382 sonic INFO kernel: [ 180.696640] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310384 sonic INFO kernel: [ 180.696641] sx_netdev: sx_netdev_dellink: called for Ethernet20
Nov 8 03:54:26.310385 sonic INFO kernel: [ 180.696645] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310387 sonic INFO kernel: [ 180.696647] sx_netdev: sx_netdev_dellink: called for Ethernet24
Nov 8 03:54:26.310388 sonic INFO kernel: [ 180.696651] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310390 sonic INFO kernel: [ 180.696652] sx_netdev: sx_netdev_dellink: called for Ethernet28
Nov 8 03:54:26.310391 sonic INFO kernel: [ 180.696656] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310393 sonic INFO kernel: [ 180.696657] sx_netdev: sx_netdev_dellink: called for Ethernet32
Nov 8 03:54:26.310394 sonic INFO kernel: [ 180.696662] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310396 sonic INFO kernel: [ 180.696663] sx_netdev: sx_netdev_dellink: called for Ethernet36
Nov 8 03:54:26.310397 sonic INFO kernel: [ 180.696667] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310399 sonic INFO kernel: [ 180.696668] sx_netdev: sx_netdev_dellink: called for Ethernet40
Nov 8 03:54:26.310400 sonic INFO kernel: [ 180.696672] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310402 sonic INFO kernel: [ 180.696673] sx_netdev: sx_netdev_dellink: called for Ethernet44
Nov 8 03:54:26.310403 sonic INFO kernel: [ 180.696678] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310405 sonic INFO kernel: [ 180.696679] sx_netdev: sx_netdev_dellink: called for Ethernet48
Nov 8 03:54:26.310406 sonic INFO kernel: [ 180.696683] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310408 sonic INFO kernel: [ 180.696684] sx_netdev: sx_netdev_dellink: called for Ethernet52
Nov 8 03:54:26.310409 sonic INFO kernel: [ 180.696688] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310410 sonic INFO kernel: [ 180.696689] sx_netdev: sx_netdev_dellink: called for Ethernet56
Nov 8 03:54:26.310412 sonic INFO kernel: [ 180.696694] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310413 sonic INFO kernel: [ 180.696695] sx_netdev: sx_netdev_dellink: called for Ethernet60
Nov 8 03:54:26.310415 sonic INFO kernel: [ 180.696699] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310416 sonic INFO kernel: [ 180.696700] sx_netdev: sx_netdev_dellink: called for Ethernet64
Nov 8 03:54:26.310418 sonic INFO kernel: [ 180.696704] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310419 sonic INFO kernel: [ 180.696705] sx_netdev: sx_netdev_dellink: called for Ethernet68
Nov 8 03:54:26.310421 sonic INFO kernel: [ 180.696709] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310422 sonic INFO kernel: [ 180.696710] sx_netdev: sx_netdev_dellink: called for Ethernet72
Nov 8 03:54:26.310424 sonic INFO kernel: [ 180.696715] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310425 sonic INFO kernel: [ 180.696716] sx_netdev: sx_netdev_dellink: called for Ethernet76
Nov 8 03:54:26.310427 sonic INFO kernel: [ 180.696720] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310428 sonic INFO kernel: [ 180.696721] sx_netdev: sx_netdev_dellink: called for Ethernet80
Nov 8 03:54:26.310430 sonic INFO kernel: [ 180.696725] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310431 sonic INFO kernel: [ 180.696726] sx_netdev: sx_netdev_dellink: called for Ethernet84
Nov 8 03:54:26.310432 sonic INFO kernel: [ 180.696731] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310434 sonic INFO kernel: [ 180.696732] sx_netdev: sx_netdev_dellink: called for Ethernet88
Nov 8 03:54:26.310435 sonic INFO kernel: [ 180.696736] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310437 sonic INFO kernel: [ 180.696737] sx_netdev: sx_netdev_dellink: called for Ethernet92
Nov 8 03:54:26.310438 sonic INFO kernel: [ 180.696741] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310440 sonic INFO kernel: [ 180.696742] sx_netdev: sx_netdev_dellink: called for Ethernet96
Nov 8 03:54:26.310441 sonic INFO kernel: [ 180.696746] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310443 sonic INFO kernel: [ 180.696748] sx_netdev: sx_netdev_dellink: called for Ethernet100
Nov 8 03:54:26.310444 sonic INFO kernel: [ 180.696752] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310445 sonic INFO kernel: [ 180.696753] sx_netdev: sx_netdev_dellink: called for Ethernet104
Nov 8 03:54:26.310447 sonic INFO kernel: [ 180.696757] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310448 sonic INFO kernel: [ 180.696758] sx_netdev: sx_netdev_dellink: called for Ethernet108
Nov 8 03:54:26.310450 sonic INFO kernel: [ 180.696762] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310451 sonic INFO kernel: [ 180.696763] sx_netdev: sx_netdev_dellink: called for Ethernet112
Nov 8 03:54:26.310453 sonic INFO kernel: [ 180.696768] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310454 sonic INFO kernel: [ 180.696769] sx_netdev: sx_netdev_dellink: called for Ethernet116
Nov 8 03:54:26.310456 sonic INFO kernel: [ 180.696773] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310469 sonic INFO kernel: [ 180.696774] sx_netdev: sx_netdev_dellink: called for Ethernet120
Nov 8 03:54:26.310472 sonic INFO kernel: [ 180.696786] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310473 sonic INFO kernel: [ 180.696787] sx_netdev: sx_netdev_dellink: called for Ethernet124
Nov 8 03:54:26.310475 sonic INFO kernel: [ 180.696792] sx_netdev: sx_netdev_dellink: exit
Nov 8 03:54:26.310476 sonic INFO kernel: [ 180.696881] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310478 sonic INFO kernel: [ 180.696882] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310479 sonic INFO kernel: [ 180.696883] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310484 sonic INFO kernel: [ 180.696884] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310486 sonic INFO kernel: [ 180.696885] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310487 sonic INFO kernel: [ 180.696886] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310489 sonic INFO kernel: [ 180.696887] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310490 sonic INFO kernel: [ 180.696888] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310491 sonic INFO kernel: [ 180.696888] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310495 sonic INFO kernel: [ 180.696889] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310497 sonic INFO kernel: [ 180.696890] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310499 sonic INFO kernel: [ 180.696891] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310500 sonic INFO kernel: [ 180.696892] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310501 sonic INFO kernel: [ 180.696893] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310503 sonic INFO kernel: [ 180.696894] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310504 sonic INFO kernel: [ 180.696895] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310516 sonic INFO kernel: [ 180.696896] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310518 sonic INFO kernel: [ 180.696897] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310520 sonic INFO kernel: [ 180.696898] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310521 sonic INFO kernel: [ 180.696899] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310523 sonic INFO kernel: [ 180.696900] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310524 sonic INFO kernel: [ 180.696901] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310528 sonic INFO kernel: [ 180.696902] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310530 sonic INFO kernel: [ 180.696903] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310531 sonic INFO kernel: [ 180.696904] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310533 sonic INFO kernel: [ 180.696905] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310534 sonic INFO kernel: [ 180.696906] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310535 sonic INFO kernel: [ 180.696907] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310537 sonic INFO kernel: [ 180.696907] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310540 sonic INFO kernel: [ 180.696908] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310542 sonic INFO kernel: [ 180.696909] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310544 sonic INFO kernel: [ 180.696910] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310545 sonic INFO kernel: [ 180.696911] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310546 sonic INFO kernel: [ 180.696912] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310548 sonic INFO kernel: [ 180.696913] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310551 sonic INFO kernel: [ 180.696914] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310553 sonic INFO kernel: [ 180.696915] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310555 sonic INFO kernel: [ 180.696916] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310556 sonic INFO kernel: [ 180.696917] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310557 sonic INFO kernel: [ 180.696918] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310559 sonic INFO kernel: [ 180.696919] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310560 sonic INFO kernel: [ 180.696920] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310564 sonic INFO kernel: [ 180.696921] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310565 sonic INFO kernel: [ 180.696922] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310567 sonic INFO kernel: [ 180.696923] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310568 sonic INFO kernel: [ 180.696923] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310570 sonic INFO kernel: [ 180.696924] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310571 sonic INFO kernel: [ 180.696925] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310572 sonic INFO kernel: [ 180.696926] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310576 sonic INFO kernel: [ 180.696927] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310578 sonic INFO kernel: [ 180.696928] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310579 sonic INFO kernel: [ 180.696929] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310581 sonic INFO kernel: [ 180.696930] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310582 sonic INFO kernel: [ 180.696931] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310583 sonic INFO kernel: [ 180.696932] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310587 sonic INFO kernel: [ 180.696933] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310589 sonic INFO kernel: [ 180.696934] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310590 sonic INFO kernel: [ 180.696935] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310591 sonic INFO kernel: [ 180.696936] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310593 sonic INFO kernel: [ 180.696937] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310594 sonic INFO kernel: [ 180.696937] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310595 sonic INFO kernel: [ 180.696938] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.310599 sonic INFO kernel: [ 180.696939] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.310601 sonic INFO kernel: [ 180.696940] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.318104 sonic INFO kernel: [ 180.704280] Bridge: port 2(Ethernet0) entered disabled state
Nov 8 03:54:26.322066 sonic INFO kernel: [ 180.708338] Bridge: port 3(Ethernet4) entered disabled state
Nov 8 03:54:26.418086 sonic INFO kernel: [ 180.805183] device Ethernet0 left promiscuous mode
Nov 8 03:54:26.418114 sonic INFO kernel: [ 180.805188] Bridge: port 2(Ethernet0) entered disabled state
Nov 8 03:54:26.438099 sonic INFO kernel: [ 180.822224] device Ethernet4 left promiscuous mode
Nov 8 03:54:26.438127 sonic INFO kernel: [ 180.822229] Bridge: port 3(Ethernet4) entered disabled state
Nov 8 03:54:26.482193 sonic INFO kernel: [ 180.866320] sx_netdev: sx_netdev_stop: called
Nov 8 03:54:26.482222 sonic INFO kernel: [ 180.866333] sx_netdev: sx_netdev_stop: exit
Nov 8 03:54:26.867403 sonic ALERT kernel: [ 180.909672] BUG: unable to handle kernel paging request at ffffffffc0d17070
Nov 8 03:54:26.867458 sonic ALERT kernel: [ 180.916738] IP: [
Can you please check if the image has the patch of https://github.com/Azure/sonic-linux-kernel/pull/154 (since it looks like https://github.com/Azure/sonic-linux-kernel/issues/153) ?
If this is master version then u need the kernel patch. If this is 201911 all should work
Get Outlook for iOShttps://aka.ms/o0ukef
From: padmanarayana notifications@github.com Sent: Sunday, November 8, 2020 7:09:04 AM To: Azure/sonic-buildimage sonic-buildimage@noreply.github.com Cc: Liat Grozovik liatg@nvidia.com; Assign assign@noreply.github.com Subject: Re: [Azure/sonic-buildimage] Config reload -y leads to kernel Oops (#5857)
Can you please check if the image has the patch of Azure/sonic-linux-kernel#154https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2Fsonic-linux-kernel%2Fpull%2F154&data=04%7C01%7Cliatg%40nvidia.com%7Ce995cd610859441c3e2c08d883a46bef%7C43083d15727340c1b7db39efd9ccc17a%7C0%7C0%7C637404089494431374%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=dfrmfP8QfAb9O1nke0nhLRqAJOX0bKoKL6gO8LDj14s%3D&reserved=0 (since it looks like Azure/sonic-linux-kernel#153https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2Fsonic-linux-kernel%2Fissues%2F153&data=04%7C01%7Cliatg%40nvidia.com%7Ce995cd610859441c3e2c08d883a46bef%7C43083d15727340c1b7db39efd9ccc17a%7C0%7C0%7C637404089494431374%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ZT5kx6TAnaeL14ENLhgZC9mbKfS%2BgkRvrGXUS%2BUxh2M%3D&reserved=0) ?
— You are receiving this because you were assigned. Reply to this email directly, view it on GitHubhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2Fsonic-buildimage%2Fissues%2F5857%23issuecomment-723531333&data=04%7C01%7Cliatg%40nvidia.com%7Ce995cd610859441c3e2c08d883a46bef%7C43083d15727340c1b7db39efd9ccc17a%7C0%7C0%7C637404089494441334%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=8DB%2Bk6pK8prgmlBA2SYGElDrVdcv8j6NiJmbBJb15%2Bg%3D&reserved=0, or unsubscribehttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAKTABA4CQNXCPX7NBSFEE5TSOYRXBANCNFSM4TOCO37A&data=04%7C01%7Cliatg%40nvidia.com%7Ce995cd610859441c3e2c08d883a46bef%7C43083d15727340c1b7db39efd9ccc17a%7C0%7C0%7C637404089494441334%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=cwOBGfkVlq7bYoTzqnTZ8abInvO3RBU15qZzXxiKlY8%3D&reserved=0.
@liat-grozovik , which kernel patch? the one posted by padman is for 201911 release.
@padmanarayana thanks a lot. I tested and you're exactly correct, my sonic-linux-kernel is too old and lack of that patch, I upgrade and it works, thank you again, I'll close this issue.
BUG REPORT INFORMATION
Description
Steps to reproduce the issue: 1.Update Mellanox SN2700 SONiC image with hw-mgmt 7.0010.1000, SAI SAIRel1.17.3-sonic1910 and FW/SDK 2008.1912/4.4.1912 2.Run sudo config reload -y 3.After 2 finished, some minutes later, run docker ps to display running dockers.
Describe the results you received: Run docker ps only display telemetry, lldp, syncd, bgp and database dockers, other dockers exited abnormally. I checked the syslog, and the log shows kernel Oops when syncd service is stopping.
Describe the results you expected: Command "sudo config reload -y" works fine with new Mellanox SAI, FW/SDK, hw-mgmt
Additional information you deem important (e.g. issue happens only occasionally):
Distribution: Debian 9.13 Kernel: 4.9.0-11-2-amd64 Build commit: 25d30306 Build date: Fri Nov 6 13:57:48 UTC 2020 Built by: shilei@linux
Platform: x86_64-mlnx_msn2700-r0 HwSKU: Mellanox-SN2700 ASIC: mellanox Serial Number: MT1741X00022 Uptime: 04:24:48 up 33 min, 1 user, load average: 0.15, 0.15, 0.51
Docker images: REPOSITORY TAG IMAGE ID SIZE docker-syncd-mlnx-rpc 201911.0-dirty-20201106.165401 ab8d877225cd 660MB docker-syncd-mlnx-rpc latest ab8d877225cd 660MB docker-platform-monitor 201911.0-dirty-20201106.165401 2e9bbe62182e 640MB docker-platform-monitor latest 2e9bbe62182e 640MB docker-sonic-mgmt-framework 201911.0-dirty-20201106.165401 439e07859515 430MB docker-sonic-mgmt-framework latest 439e07859515 430MB docker-snmp-sv2 201911.0-dirty-20201106.165401 ae9562e07e42 346MB docker-snmp-sv2 latest ae9562e07e42 346MB docker-mstpd 201911.0-dirty-20201106.165401 7e45aedd069a 316MB docker-mstpd latest 7e45aedd069a 316MB docker-fpm-frr 201911.0-dirty-20201106.165401 e91ddf9efb15 334MB docker-fpm-frr latest e91ddf9efb15 334MB docker-neighbor-proxy 201911.0-dirty-20201106.165401 45e126db02cd 314MB docker-neighbor-proxy latest 45e126db02cd 314MB docker-sonic-telemetry 201911.0-dirty-20201106.165401 8dd9b9e35c32 353MB docker-sonic-telemetry latest 8dd9b9e35c32 353MB docker-lldp-sv2 201911.0-dirty-20201106.165401 cd9fb4a28cdf 319MB docker-lldp-sv2 latest cd9fb4a28cdf 319MB docker-web-server 201911.0-dirty-20201106.165401 13e6ef0e2ca4 347MB docker-web-server latest 13e6ef0e2ca4 347MB docker-dhcp-relay 201911.0-dirty-20201106.165401 2a5e105668f8 299MB docker-dhcp-relay latest 2a5e105668f8 299MB docker-router-advertiser 201911.0-dirty-20201106.165401 0e36aec3a1e9 288MB docker-router-advertiser latest 0e36aec3a1e9 288MB docker-database 201911.0-dirty-20201106.165401 cd6dd1f6c2a4 288MB docker-database latest cd6dd1f6c2a4 288MB docker-orchagent 201911.0-dirty-20201106.165401 9c06de19f9c1 334MB docker-orchagent latest 9c06de19f9c1 334MB docker-iccpd 201911.0-dirty-20201106.165401 2c7855c74a33 315MB docker-iccpd latest 2c7855c74a33 315MB docker-teamd 201911.0-dirty-20201106.165401 4c89a5373b1f 314MB docker-teamd latest 4c89a5373b1f 314MB docker-sflow 201911.0-dirty-20201106.165401 c39a8f46ce2d 314MB docker-sflow latest c39a8f46ce2d 314MB docker-slad 201911.0-dirty-20201106.165401 ba302f8f9b78 318MB docker-slad latest ba302f8f9b78 318MB docker-wjh 201911.master.0-dirty-20200927.084123 1297bccc3538 329MB docker-wjh latest 1297bccc3538 329MB
Nov 08 04:25:43 INFO LOG: Initializing SX log with STDOUT as output file. Nov 08 04:25:43 ERROR SX_API_INIT: Could not open SX-API client communication channel. mlnx_sai_switch.c[5551]- mlnx_connect_switch: Can't open connection to SDK - Communication Error. Failed to create a switch rc=-1 tar: sai_sdk_dump_11_08_2020_04_25_AM: Cannot stat: No such file or directory tar: Exiting with failure status due to previous errors gzip: /tmp/sai_sdk_dump_11_08_2020_04_25_AM: No such file or directory tar: sonic_dump_sonic_20201108_042522/etc/rc0.d/K01docker: File removed before we read it tar: sonic_dump_sonic_20201108_042522/etc/rc1.d/K01docker: File removed before we read it tar: sonic_dump_sonic_20201108_042522/etc/rc2.d/S01docker: File removed before we read it tar: sonic_dump_sonic_20201108_042522/etc/rc3.d/S01docker: File removed before we read it tar: sonic_dump_sonic_20201108_042522/etc/rc4.d/S01docker: File removed before we read it tar: sonic_dump_sonic_20201108_042522/etc/rc5.d/S01docker: File removed before we read it tar: sonic_dump_sonic_20201108_042522/etc/rc6.d/K01docker: File removed before we read it Tar append operation failed. Aborting for safety. /var/dump/sonic_dump_sonic_20201108_042522.tar.gz