search

sonic-net / sonic-buildimage

Scripts which perform an installable binary image build for SONiC
Other
724 stars 1.38k forks source link

[fast-reboot][master] SYNCD busy loop slows down reconciliation and causes increased downtime #9901

Open vaibhavhd opened 2 years ago

vaibhavhd commented 2 years ago

Description

Steps to reproduce the issue:

  1. Install latest master image.
  2. Fast-reboot.

Describe the results you received:

Fast reboot goes ahead, but fails the 30s downtime SLA, as the syncd appears to be in busy loop, which must have slowed the reconciliation:

Jan 31 21:57:34.728533 str-7260cx3-acs-1 NOTICE admin: Rebooting with /sbin/kexec -e to SONiC-OS-master.68799-f8fd2defb ...
Jan 31 21:58:07.943944 str-7260cx3-acs-1 NOTICE swss#orchagent: :- notifySyncd: sending syncd: INIT_VIEW
Jan 31 21:58:09.322182 str-7260cx3-acs-1 NOTICE syncd#syncd: :- processNotifySyncd: very first run is TRUE, op = INIT_VIEW
Jan 31 21:58:09.322182 str-7260cx3-acs-1 NOTICE syncd#syncd: :- clearTempView: clearing current TEMP VIEW
Jan 31 21:58:09.322605 str-7260cx3-acs-1 NOTICE swss#orchagent: :- sai_redis_notify_syncd: switched ASIC to INIT VIEW
Jan 31 21:58:09.322712 str-7260cx3-acs-1 NOTICE swss#orchagent: :- initSaiRedis: Notify syncd INIT_VIEW

Jan 31 21:58:19.101092 str-7260cx3-acs-1 NOTICE swss#orchagent: :- syncd_apply_view: Notify syncd APPLY_VIEW
Jan 31 21:58:19.101092 str-7260cx3-acs-1 NOTICE swss#orchagent: :- notifySyncd: sending syncd: APPLY_VIEW
Jan 31 21:58:19.101317 str-7260cx3-acs-1 NOTICE syncd#syncd: :- processNotifySyncd: very first run is TRUE, op = APPLY_VIEW
Jan 31 21:58:19.101386 str-7260cx3-acs-1 NOTICE syncd#syncd: :- processNotifySyncd: setting very first run to FALSE, op = APPLY_VIEW
Jan 31 21:58:19.101561 str-7260cx3-acs-1 NOTICE swss#orchagent: :- sai_redis_notify_syncd: switched ASIC to APPLY VIEW

But, in syslog,, below lines keep appearing from syncd:

Jan 31 22:52:41.756990 str-7260cx3-acs-1 INFO syncd#syncd: [none] SAI_API_PORT:brcm_sai_get_port_stats:4998 Get Port Phy Control FEC Symbol Error Count failed with error Feature unavailable (0xfffffff0).
Jan 31 22:52:41.756990 str-7260cx3-acs-1 ERR syncd#syncd: :- collectPortCounters: Failed to get stats of port 0x100000042: -2
Jan 31 22:52:41.781022 str-7260cx3-acs-1 INFO syncd#syncd: [none] SAI_API_PORT:brcm_sai_get_port_stats:4998 Get Port Phy Control FEC Symbol Error Count failed with error Feature unavailable (0xfffffff0).
Jan 31 22:52:41.781022 str-7260cx3-acs-1 ERR syncd#syncd: :- collectPortCounters: Failed to get stats of port 0x100000064: -2
Jan 31 22:52:41.853697 str-7260cx3-acs-1 ERR syncd#syncd: :- guard: RedisReply catches system_error: command: *129#015#012$7#015#012EVALSHA#015#012$40#015#012db030d61747eb633f38f61ddeaed7f27739807d0#015#012$3#015#012122#015#012$19#015#012oid:0x1000000000002#015#012$19#015#012oid:0x1000000000003#015#012$19#015#012oid:0x1000000000004#015#012$19#015#012oid:0x1000000000005#015#012$19#015#012oid:0x1000000000006#015#012$19#015#012oid:0x1000000000007#015#012$19#015#012oid:0x1000000000008#015#012$19#015#012oid:0x1000000000009#015#012$19#015#012oid:0x100000000000a#015#012$19#015#012oid:0x100000000000b#015#012$19#015#012oid:0x100000000000c#015#012$19#015#012oid:0x100000000000d#015#012$19#015#012oid:0x100000000000e#015#012$19#015#012oid:0x100000000000f#015#012$19#015#012oid:0x1000000000010#015#012$19#015#012oid:0x1000000000011#015#012$19#015#012oid:0x1000000000012#015#012$19#015#012oid:0x1000000000013#015#012$19#015#012oid:0x1000000000014#015#012$19#015#012oid:0x1000000000015#015#012$19#015#012oid:0x1000000000016#015#012$19#015#012oid:0x1000000000017#015#012$19#015#012oid:0x1000000000018#015#012$19#015#012oid:0x1000000000019#015#012$19#015#012oid:0x100000000001a#015#012$19#015#012oid:0x100000000001b#015#012$19#015#012oid:0x100000000001c#015#012$19#015#012oid:0x100000000001d#015#012$19#015#012oid:0x100000000001e#015#012$19#015#012oid:0x100000000001f#015#012$19#015#012oid:0x1000000000020#015#012$19#015#012oid:0x1000000000021#015#012$19#015#012oid:0x1000000000022#015#012$19#015#012oid:0x1000000000023#015#012$19#015#012oid:0x1000000000024#015#012$19#015#012oid:0x1000000000025#015#012$19#015#012oid:0x1000000000026#015#012$19#015#012oid:0x1000000000027#015#012$19#015#012oid:0x1000000000028#015#012$19#015#012oid:0x1000000000029#015#012$19#015#012oid:0x100000000002a#015#012$19#015#012oid:0x100000000002b#015#012$19#015#012oid:0x100000000002c#015#012$19#015#012oid:0x100000000002d#015#012$19#015#012oid:0x100000000002e#015#012$19#015#012oid:0x100000000002f#015#012$19#015#012oid:0x1000000000030#015#012$19#015#012oid:0x1000000000031#015#012$19#015#012oid:0x1000000000032#015#012$19#015#012oid:0x1000000000033#015#012$19#015#012oid:0x1000000000034#015#012$19#015#012oid:0x1000000000035#015#012$19#015#012oid:0x1000000000036#015#012$19#015#012oid:0x1000000000037#015#012$19#015#012oid:0x1000000000038#015#012$19#015#012oid:0x1000000000039#015#012$19#015#012oid:0x100000000003a#015#012$19#015#012oid:0x100000000003b#015#012$19#015#012oid:0x100000000003c#015#012$19#015#012oid:0x100000000003d#015#012$19#015#012oid:0x100000000003e#015#012$19#015#012oid:0x100000000003f#015#012$19#015#012oid:0x1000000000040#015#012$19#015#012oid:0x1000000000041#015#012$19#015#012oid:0x1000000000042#015#012$19#015#012oid:0x1000000000043#015#012$19#015#012oid:0x1000000000044#015#012$19#015#012oid:0x1000000000045#015#012$19#015#012oid:0x1000000000046#015#012$19#015#012oid:0x1000000000047#015#012$19#015#012oid:0x1000000000048#015#012$19#015#012oid:0x1000000000049#015#012$19#015#012oid:0x100000000004a#015#012$19#015#012oid:0x100000000004b#015#012$19#015#012oid:0x100000000004c#015#012$19#015#012oid:0x100000000004d#015#012$19#015#012oid:0x100000000004e#015#012$19#015#012oid:0x100000000004f#015#012$19#015#012oid:0x1000000000050#015#012$19#015#012oid:0x1000000000051#015#012$19#015#012oid:0x1000000000052#015#012$19#015#012oid:0x1000000000053#015#012$19#015#012oid:0x1000000000054#015#012$19#015#012oid:0x1000000000055#015#012$19#015#012oid:0x1000000000056#015#012$19#015#012oid:0x1000000000057#015#012$19#015#012oid:0x1000000000058#015#012$19#015#012oid:0x1000000000059#015#012$19#015#012oid:0x100000000005a#015#012$19#015#012oid:0x100000000005b#015#012$19#015#012oid:0x100000000005c#015#012$19#015#012oid:0x100000000005d#015#012$19#015#012oid:0x100000000005e#015#012$19#015#012oid:0x100000000005f#015#012$19#015#012oid:0x1000000000060#015#012$19#015#012oid:0x1000000000061#015#012$19#015#012oid:0x1000000000062#015#012$19#015#012oid:0x1000000000063#015#012$19#015#012oid:0x1000000000064#015#012$19#015#012oid:0x1000000000065#015#012$19#015#012oid:0x1000000000066#015#012$19#015#012oid:0x1000000000067#015#012$19#015#012oid:0x1000000000068#015#012$19#015#012oid:0x1000000000069#015#012$19#015#012oid:0x100000000006a#015#012$19#015#012oid:0x100000000006b#015#012$19#015#012oid:0x100000000006c#015#012$19#015#012oid:0x100000000006d#015#012$19#015#012oid:0x100000000006e#015#012$19#015#012oid:0x100000000006f#015#012$19#015#012oid:0x1000000000070#015#012$19#015#012oid:0x1000000000071#015#012$19#015#012oid:0x1000000000072#015#012$19#015#012oid:0x1000000000073#015#012$19#015#012oid:0x1000000000074#015#012$19#015#012oid:0x1000000000075#015#012$19#015#012oid:0x1000000000076#015#012$19#015#012oid:0x1000000000077#015#012$19#015#012oid:0x1000000000078#015#012$19#015#012oid:0x1000000000079#015#012$19#015#012oid:0x100000000007a#015#012$19#015#012oid:0x100000000007b#015#012$1#015#0122#015#012$8#015#012COUNTERS#015#012$4#015#0121000#015#012$2#015#012''#015#012, reason: ERR Error running script (call to f_db030d61747eb633f38f61ddeaed7f27739807d0): @user_script:56: user_script:56: attempt to perform arithmetic on local 'in_octets' (a boolean value) : Input/output error
Jan 31 22:52:41.853697 str-7260cx3-acs-1 ERR syncd#syncd: :- runRedisScript: Caught exception while running Redis lua script: RedisReply catches system_error: command: *129#015#012$7#015#012EVALSHA#015#012$40#015#012db030d61747eb633f38f61ddeaed7f27739807d0#015#012$3#015#012122#015#012$19#015#012oid:0x1000000000002#015#012$19#015#012oid:0x1000000000003#015#012$19#015#012oid:0x1000000000004#015#012$19#015#012oid:0x1000000000005#015#012$19#015#012oid:0x1000000000006#015#012$19#015#012oid:0x1000000000007#015#012$19#015#012oid:0x1000000000008#015#012$19#015#012oid:0x1000000000009#015#012$19#015#012oid:0x100000000000a#015#012$19#015#012oid:0x100000000000b#015#012$19#015#012oid:0x100000000000c#015#012$19#015#012oid:0x100000000000d#015#012$19#015#012oid:0x100000000000e#015#012$19#015#012oid:0x100000000000f#015#012$19#015#012oid:0x1000000000010#015#012$19#015#012oid:0x1000000000011#015#012$19#015#012oid:0x1000000000012#015#012$19#015#012oid:0x1000000000013#015#012$19#015#012oid:0x1000000000014#015#012$19#015#012oid:0x1000000000015#015#012$19#015#012oid:0x1000000000016#015#012$19#015#012oid:0x1000000000017#015#012$19#015#012oid:0x1000000000018#015#012$19#015#012oid:0x1000000000019#015#012$19#015#012oid:0x100000000001a#015#012$19#015#012oid:0x100000000001b#015#012$19#015#012oid:0x100000000001c#015#012$19#015#012oid:0x100000000001d#015#012$19#015#012oid:0x100000000001e#015#012$19#015#012oid:0x100000000001f#015#012$19#015#012oid:0x1000000000020#015#012$19#015#012oid:0x1000000000021#015#012$19#015#012oid:0x1000000000022#015#012$19#015#012oid:0x1000000000023#015#012$19#015#012oid:0x1000000000024#015#012$19#015#012oid:0x1000000000025#015#012$19#015#012oid:0x1000000000026#015#012$19#015#012oid:0x1000000000027#015#012$19#015#012oid:0x1000000000028#015#012$19#015#012oid:0x1000000000029#015#012$19#015#012oid:0x100000000002a#015#012$19#015#012oid:0x100000000002b#015#012$19#015#012oid:0x100000000002c#015#012$19#015#012oid:0x100000000002d#015#012$19#015#012oid:0x100000000002e#015#012$19#015#012oid:0x100000000002f#015#012$19#015#012oid:0x1000000000030#015#012$19#015#012oid:0x1000000000031#015#012$19#015#012oid:0x1000000000032#015#012$19#015#012oid:0x1000000000033#015#012$19#015#012oid:0x1000000000034#015#012$19#015#012oid:0x1000000000035#015#012$19#015#012oid:0x1000000000036#015#012$19#015#012oid:0x1000000000037#015#012$19#015#012oid:0x1000000000038#015#012$19#015#012oid:0x1000000000039#015#012$19#015#012oid:0x100000000003a#015#012$19#015#012oid:0x100000000003b#015#012$19#015#012oid:0x100000000003c#015#012$19#015#012oid:0x100000000003d#015#012$19#015#012oid:0x100000000003e#015#012$19#015#012oid:0x100000000003f#015#012$19#015#012oid:0x1000000000040#015#012$19#015#012oid:0x1000000000041#015#012$19#015#012oid:0x1000000000042#015#012$19#015#012oid:0x1000000000043#015#012$19#015#012oid:0x1000000000044#015#012$19#015#012oid:0x1000000000045#015#012$19#015#012oid:0x1000000000046#015#012$19#015#012oid:0x1000000000047#015#012$19#015#012oid:0x1000000000048#015#012$19#015#012oid:0x1000000000049#015#012$19#015#012oid:0x100000000004a#015#012$19#015#012oid:0x100000000004b#015#012$19#015#012oid:0x100000000004c#015#012$19#015#012oid:0x100000000004d#015#012$19#015#012oid:0x100000000004e#015#012$19#015#012oid:0x100000000004f#015#012$19#015#012oid:0x1000000000050#015#012$19#015#012oid:0x1000000000051#015#012$19#015#012oid:0x1000000000052#015#012$19#015#012oid:0x1000000000053#015#012$19#015#012oid:0x1000000000054#015#012$19#015#012oid:0x1000000000055#015#012$19#015#012oid:0x1000000000056#015#012$19#015#012oid:0x1000000000057#015#012$19#015#012oid:0x1000000000058#015#012$19#015#012oid:0x1000000000059#015#012$19#015#012oid:0x100000000005a#015#012$19#015#012oid:0x100000000005b#015#012$19#015#012oid:0x100000000005c#015#012$19#015#012oid:0x100000000005d#015#012$19#015#012oid:0x100000000005e#015#012$19#015#012oid:0x100000000005f#015#012$19#015#012oid:0x1000000000060#015#012$19#015#012oid:0x1000000000061#015#012$19#015#012oid:0x1000000000062#015#012$19#015#012oid:0x1000000000063#015#012$19#015#012oid:0x1000000000064#015#012$19#015#012oid:0x1000000000065#015#012$19#015#012oid:0x1000000000066#015#012$19#015#012oid:0x1000000000067#015#012$19#015#012oid:0x1000000000068#015#012$19#015#012oid:0x1000000000069#015#012$19#015#012oid:0x100000000006a#015#012$19#015#012oid:0x100000000006b#015#012$19#015#012oid:0x100000000006c#015#012$19#015#012oid:0x100000000006d#015#012$19#015#012oid:0x100000000006e#015#012$19#015#012oid:0x100000000006f#015#012$19#015#012oid:0x1000000000070#015#012$19#015#012oid:0x1000000000071#015#012$19#015#012oid:0x1000000000072#015#012$19#015#012oid:0x1000000000073#015#012$19#015#012oid:0x1000000000074#015#012$19#015#012oid:0x1000000000075#015#012$19#015#012oid:0x1000000000076#015#012$19#015#012oid:0x1000000000077#015#012$19#015#012oid:0x1000000000078#015#012$19#015#012oid:0x1000000000079#015#012$19#015#012oid:0x100000000007a#015#012$19#015#012oid:0x100000000007b#015#012$1#015#0122#015#012$8#015#012COUNTERS#015#012$4#015#0121000#015#012$2#015#012''#015#012, reason: ERR Error running script (call to f_db030d61747eb633f38f61ddeaed7f27739807d0): @user_script:56: user_script:56: attempt to perform arithmetic on local 'in_octets' (a boolean value) : Input/output error: Input/output error
Jan 31 22:52:42.649266 str-7260cx3-acs-1 INFO syncd#syncd: [none] SAI_API_PORT:brcm_sai_get_port_stats:4998 Get Port Phy Control FEC Symbol Error Count failed with error Feature unavailable (0xfffffff0).
Jan 31 22:52:42.649266 str-7260cx3-acs-1 ERR syncd#syncd: :- collectPortCounters: Failed to get stats of port 0x100000042: -2
Jan 31 22:52:42.676913 str-7260cx3-acs-1 INFO syncd#syncd: [none] SAI_API_PORT:brcm_sai_get_port_stats:4998 Get Port Phy Control FEC Symbol Error Count failed with error Feature unavailable (0xfffffff0).
Jan 31 22:52:42.676913 str-7260cx3-acs-1 ERR syncd#syncd: :- collectPortCounters: Failed to get stats of port 0x100000064: -2
Jan 31 22:52:42.735420 str-7260cx3-acs-1 ERR syncd#syncd: :- guard: RedisReply catches system_error: command: *129#015#012$7#015#012EVALSHA#015#012$40#015#012db030d61747eb633f38f61ddeaed7f27739807d0#015#012$3#015#012122#015#012$19#015#012oid:0x1000000000002#015#012$19#015#012oid:0x1000000000003#015#012$19#015#012oid:0x1000000000004#015#012$19#015#012oid:0x1000000000005#015#012$19#015#012oid:0x1000000000006#015#012$19#015#012oid:0x1000000000007#015#012$19#015#012oid:0x1000000000008#015#012$19#015#012oid:0x1000000000009#015#012$19#015#012oid:0x100000000000a#015#012$19#015#012oid:0x100000000000b#015#012$19#015#012oid:0x100000000000c#015#012$19#015#012oid:0x100000000000d#015#012$19#015#012oid:0x100000000000e#015#012$19#015#012oid:0x100000000000f#015#012$19#015#012oid:0x1000000000010#015#012$19#015#012oid:0x1000000000011#015#012$19#015#012oid:0x1000000000012#015#012$19#015#012oid:0x1000000000013#015#012$19#015#012oid:0x1000000000014#015#012$19#015#012oid:0x1000000000015#015#012$19#015#012oid:0x1000000000016#015#012$19#015#012oid:0x1000000000017#015#012$19#015#012oid:0x1000000000018#015#012$19#015#012oid:0x1000000000019#015#012$19#015#012oid:0x100000000001a#015#012$19#015#012oid:0x100000000001b#015#012$19#015#012oid:0x100000000001c#015#012$19#015#012oid:0x100000000001d#015#012$19#015#012oid:0x100000000001e#015#012$19#015#012oid:0x100000000001f#015#012$19#015#012oid:0x1000000000020#015#012$19#015#012oid:0x1000000000021#015#012$19#015#012oid:0x1000000000022#015#012$19#015#012oid:0x1000000000023#015#012$19#015#012oid:0x1000000000024#015#012$19#015#012oid:0x1000000000025#015#012$19#015#012oid:0x1000000000026#015#012$19#015#012oid:0x1000000000027#015#012$19#015#012oid:0x1000000000028#015#012$19#015#012oid:0x1000000000029#015#012$19#015#012oid:0x100000000002a#015#012$19#015#012oid:0x100000000002b#015#012$19#015#012oid:0x100000000002c#015#012$19#015#012oid:0x100000000002d#015#012$19#015#012oid:0x100000000002e#015#012$19#015#012oid:0x100000000002f#015#012$19#015#012oid:0x1000000000030#015#012$19#015#012oid:0x1000000000031#015#012$19#015#012oid:0x1000000000032#015#012$19#015#012oid:0x1000000000033#015#012$19#015#012oid:0x1000000000034#015#012$19#015#012oid:0x1000000000035#015#012$19#015#012oid:0x1000000000036#015#012$19#015#012oid:0x1000000000037#015#012$19#015#012oid:0x1000000000038#015#012$19#015#012oid:0x1000000000039#015#012$19#015#012oid:0x100000000003a#015#012$19#015#012oid:0x100000000003b#015#012$19#015#012oid:0x100000000003c#015#012$19#015#012oid:0x100000000003d#015#012$19#015#012oid:0x100000000003e#015#012$19#015#012oid:0x100000000003f#015#012$19#015#012oid:0x1000000000040#015#012$19#015#012oid:0x1000000000041#015#012$19#015#012oid:0x1000000000042#015#012$19#015#012oid:0x1000000000043#015#012$19#015#012oid:0x1000000000044#015#012$19#015#012oid:0x1000000000045#015#012$19#015#012oid:0x1000000000046#015#012$19#015#012oid:0x1000000000047#015#012$19#015#012oid:0x1000000000048#015#012$19#015#012oid:0x1000000000049#015#012$19#015#012oid:0x100000000004a#015#012$19#015#012oid:0x100000000004b#015#012$19#015#012oid:0x100000000004c#015#012$19#015#012oid:0x100000000004d#015#012$19#015#012oid:0x100000000004e#015#012$19#015#012oid:0x100000000004f#015#012$19#015#012oid:0x1000000000050#015#012$19#015#012oid:0x1000000000051#015#012$19#015#012oid:0x1000000000052#015#012$19#015#012oid:0x1000000000053#015#012$19#015#012oid:0x1000000000054#015#012$19#015#012oid:0x1000000000055#015#012$19#015#012oid:0x1000000000056#015#012$19#015#012oid:0x1000000000057#015#012$19#015#012oid:0x1000000000058#015#012$19#015#012oid:0x1000000000059#015#012$19#015#012oid:0x100000000005a#015#012$19#015#012oid:0x100000000005b#015#012$19#015#012oid:0x100000000005c#015#012$19#015#012oid:0x100000000005d#015#012$19#015#012oid:0x100000000005e#015#012$19#015#012oid:0x100000000005f#015#012$19#015#012oid:0x1000000000060#015#012$19#015#012oid:0x1000000000061#015#012$19#015#012oid:0x1000000000062#015#012$19#015#012oid:0x1000000000063#015#012$19#015#012oid:0x1000000000064#015#012$19#015#012oid:0x1000000000065#015#012$19#015#012oid:0x1000000000066#015#012$19#015#012oid:0x1000000000067#015#012$19#015#012oid:0x1000000000068#015#012$19#015#012oid:0x1000000000069#015#012$19#015#012oid:0x100000000006a#015#012$19#015#012oid:0x100000000006b#015#012$19#015#012oid:0x100000000006c#015#012$19#015#012oid:0x100000000006d#015#012$19#015#012oid:0x100000000006e#015#012$19#015#012oid:0x100000000006f#015#012$19#015#012oid:0x1000000000070#015#012$19#015#012oid:0x1000000000071#015#012$19#015#012oid:0x1000000000072#015#012$19#015#012oid:0x1000000000073#015#012$19#015#012oid:0x1000000000074#015#012$19#015#012oid:0x1000000000075#015#012$19#015#012oid:0x1000000000076#015#012$19#015#012oid:0x1000000000077#015#012$19#015#012oid:0x1000000000078#015#012$19#015#012oid:0x1000000000079#015#012$19#015#012oid:0x100000000007a#015#012$19#015#012oid:0x100000000007b#015#012$1#015#0122#015#012$8#015#012COUNTERS#015#012$4#015#0121000#015#012$2#015#012''#015#012, reason: ERR Error running script (call to f_db030d61747eb633f38f61ddeaed7f27739807d0): @user_script:56: user_script:56: attempt to perform arithmetic on local 'in_octets' (a boolean value) : Input/output error
Jan 31 22:52:42.735420 str-7260cx3-acs-1 ERR syncd#syncd: :- runRedisScript: Caught exception while running Redis lua script: RedisReply catches system_error: command: *129#015#012$7#015#012EVALSHA#015#012$40#015#012db030d61747eb633f38f61ddeaed7f27739807d0#015#012$3#015#012122#015#012$19#015#012oid:0x1000000000002#015#012$19#015#012oid:0x1000000000003#015#012$19#015#012oid:0x1000000000004#015#012$19#015#012oid:0x1000000000005#015#012$19#015#012oid:0x1000000000006#015#012$19#015#012oid:0x1000000000007#015#012$19#015#012oid:0x1000000000008#015#012$19#015#012oid:0x1000000000009#015#012$19#015#012oid:0x100000000000a#015#012$19#015#012oid:0x100000000000b#015#012$19#015#012oid:0x100000000000c#015#012$19#015#012oid:0x100000000000d#015#012$19#015#012oid:0x100000000000e#015#012$19#015#012oid:0x100000000000f#015#012$19#015#012oid:0x1000000000010#015#012$19#015#012oid:0x1000000000011#015#012$19#015#012oid:0x1000000000012#015#012$19#015#012oid:0x1000000000013#015#012$19#015#012oid:0x1000000000014#015#012$19#015#012oid:0x1000000000015#015#012$19#015#012oid:0x1000000000016#015#012$19#015#012oid:0x1000000000017#015#012$19#015#012oid:0x1000000000018#015#012$19#015#012oid:0x1000000000019#015#012$19#015#012oid:0x100000000001a#015#012$19#015#012oid:0x100000000001b#015#012$19#015#012oid:0x100000000001c#015#012$19#015#012oid:0x100000000001d#015#012$19#015#012oid:0x100000000001e#015#012$19#015#012oid:0x100000000001f#015#012$19#015#012oid:0x1000000000020#015#012$19#015#012oid:0x1000000000021#015#012$19#015#012oid:0x1000000000022#015#012$19#015#012oid:0x1000000000023#015#012$19#015#012oid:0x1000000000024#015#012$19#015#012oid:0x1000000000025#015#012$19#015#012oid:0x1000000000026#015#012$19#015#012oid:0x1000000000027#015#012$19#015#012oid:0x1000000000028#015#012$19#015#012oid:0x1000000000029#015#012$19#015#012oid:0x100000000002a#015#012$19#015#012oid:0x100000000002b#015#012$19#015#012oid:0x100000000002c#015#012$19#015#012oid:0x100000000002d#015#012$19#015#012oid:0x100000000002e#015#012$19#015#012oid:0x100000000002f#015#012$19#015#012oid:0x1000000000030#015#012$19#015#012oid:0x1000000000031#015#012$19#015#012oid:0x1000000000032#015#012$19#015#012oid:0x1000000000033#015#012$19#015#012oid:0x1000000000034#015#012$19#015#012oid:0x1000000000035#015#012$19#015#012oid:0x1000000000036#015#012$19#015#012oid:0x1000000000037#015#012$19#015#012oid:0x1000000000038#015#012$19#015#012oid:0x1000000000039#015#012$19#015#012oid:0x100000000003a#015#012$19#015#012oid:0x100000000003b#015#012$19#015#012oid:0x100000000003c#015#012$19#015#012oid:0x100000000003d#015#012$19#015#012oid:0x100000000003e#015#012$19#015#012oid:0x100000000003f#015#012$19#015#012oid:0x1000000000040#015#012$19#015#012oid:0x1000000000041#015#012$19#015#012oid:0x1000000000042#015#012$19#015#012oid:0x1000000000043#015#012$19#015#012oid:0x1000000000044#015#012$19#015#012oid:0x1000000000045#015#012$19#015#012oid:0x1000000000046#015#012$19#015#012oid:0x1000000000047#015#012$19#015#012oid:0x1000000000048#015#012$19#015#012oid:0x1000000000049#015#012$19#015#012oid:0x100000000004a#015#012$19#015#012oid:0x100000000004b#015#012$19#015#012oid:0x100000000004c#015#012$19#015#012oid:0x100000000004d#015#012$19#015#012oid:0x100000000004e#015#012$19#015#012oid:0x100000000004f#015#012$19#015#012oid:0x1000000000050#015#012$19#015#012oid:0x1000000000051#015#012$19#015#012oid:0x1000000000052#015#012$19#015#012oid:0x1000000000053#015#012$19#015#012oid:0x1000000000054#015#012$19#015#012oid:0x1000000000055#015#012$19#015#012oid:0x1000000000056#015#012$19#015#012oid:0x1000000000057#015#012$19#015#012oid:0x1000000000058#015#012$19#015#012oid:0x1000000000059#015#012$19#015#012oid:0x100000000005a#015#012$19#015#012oid:0x100000000005b#015#012$19#015#012oid:0x100000000005c#015#012$19#015#012oid:0x100000000005d#015#012$19#015#012oid:0x100000000005e#015#012$19#015#012oid:0x100000000005f#015#012$19#015#012oid:0x1000000000060#015#012$19#015#012oid:0x1000000000061#015#012$19#015#012oid:0x1000000000062#015#012$19#015#012oid:0x1000000000063#015#012$19#015#012oid:0x1000000000064#015#012$19#015#012oid:0x1000000000065#015#012$19#015#012oid:0x1000000000066#015#012$19#015#012oid:0x1000000000067#015#012$19#015#012oid:0x1000000000068#015#012$19#015#012oid:0x1000000000069#015#012$19#015#012oid:0x100000000006a#015#012$19#015#012oid:0x100000000006b#015#012$19#015#012oid:0x100000000006c#015#012$19#015#012oid:0x100000000006d#015#012$19#015#012oid:0x100000000006e#015#012$19#015#012oid:0x100000000006f#015#012$19#015#012oid:0x1000000000070#015#012$19#015#012oid:0x1000000000071#015#012$19#015#012oid:0x1000000000072#015#012$19#015#012oid:0x1000000000073#015#012$19#015#012oid:0x1000000000074#015#012$19#015#012oid:0x1000000000075#015#012$19#015#012oid:0x1000000000076#015#012$19#015#012oid:0x1000000000077#015#012$19#015#012oid:0x1000000000078#015#012$19#015#012oid:0x1000000000079#015#012$19#015#012oid:0x100000000007a#015#012$19#015#012oid:0x100000000007b#015#012$1#015#0122#015#012$8#015#012COUNTERS#015#012$4#015#0121000#015#012$2#015#012''#015#012, reason: ERR Error running script (call to f_db030d61747eb633f38f61ddeaed7f27739807d0): @user_script:56: user_script:56: attempt to perform arithmetic on local 'in_octets' (a boolean value) : Input/output error: Input/output error

Describe the results you expected:

Output of show version:

(paste your output here)

Output of show techsupport:

(paste your output here or download and attach the file here )

Additional information you deem important (e.g. issue happens only occasionally):

MikeHcChen commented 2 years ago

I have this problem too on two ports which connected with Broadcom Tomahawk3 BCM56980 chip directly. I think there is a parameter should be set in xxxx.config.bcm of SONiC device. However, I don't know what the correct parameter is. Anyone has idea about this topic? Thanks.