search

sonic-net / sonic-swss

SONiC Switch State Service (SwSS)
https://azure.github.io/SONiC
Other
170 stars 503 forks source link

orchagent applies QOS config out of order on breakout ports while executing "config interface breakout with -l option" #3234

Open skumar041 opened 1 month ago

skumar041 commented 1 month ago

Sonic Version:202405

config interface breakout Ethernet104 "4x25G(4)" -yfl Running Breakout Mode : 8x50G[25G,10G] Target Breakout Mode : 4x25G(4)

Ports to be deleted : { "Ethernet104": "50000", "Ethernet105": "50000", "Ethernet106": "50000", "Ethernet107": "50000", "Ethernet108": "50000", "Ethernet109": "50000", "Ethernet110": "50000", "Ethernet111": "50000" } Ports to be added : { "Ethernet104": "25000", "Ethernet105": "25000", "Ethernet106": "25000", "Ethernet107": "25000" } Breakout process got successfully completed. Please note loaded setting will be lost after system reboot. To preserve setting, run config save.

Problem definition: Orchagent applies the qos config before creating the breakout ports, basically all port config should get applied on breakout ports after the port creation

syslog snippet for ports delete:

024 Jul 11 11:52:35.301251 sonic NOTICE swss#orchagent: :- doPortTask: Removed port Ethernet104 2024 Jul 11 11:52:35.869520 sonic NOTICE swss#orchagent: :- doPortTask: Removed port Ethernet105 2024 Jul 11 11:52:36.029616 sonic NOTICE swss#orchagent: :- doPortTask: Removed port Ethernet106 2024 Jul 11 11:52:36.159443 sonic NOTICE swss#orchagent: :- doPortTask: Removed port Ethernet107 2024 Jul 11 11:52:36.305348 sonic NOTICE swss#orchagent: :- doPortTask: Removed port Ethernet108 2024 Jul 11 11:52:36.881091 sonic NOTICE swss#orchagent: :- doPortTask: Removed port Ethernet109 2024 Jul 11 11:52:37.000343 sonic NOTICE swss#orchagent: :- doPortTask: Removed port Ethernet110 2024 Jul 11 11:52:37.239121 sonic NOTICE swss#orchagent: :- doPortTask: Removed port Ethernet111

syslog snippet for qos config applying on ports before port creation:

024 Jul 11 11:52:37.757545 sonic NOTICE swss#orchagent: :- processPriorityGroup: Set buffer PG Ethernet104:0 to BUFFER_PROFILE_TABLE:ingress_lossy_profile 2024 Jul 11 11:52:37.757545 sonic ERR swss#orchagent: :- processPriorityGroup: Port with alias:Ethernet104 not found 2024 Jul 11 11:52:37.757606 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:37.757606 sonic NOTICE swss#orchagent: :- processPriorityGroup: Set buffer PG Ethernet105:0 to BUFFER_PROFILE_TABLE:ingress_lossy_profile 2024 Jul 11 11:52:37.757606 sonic ERR swss#orchagent: :- processPriorityGroup: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:37.757666 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:37.759116 sonic NOTICE swss#orchagent: :- processPriorityGroup: Set buffer PG Ethernet106:0 to BUFFER_PROFILE_TABLE:ingress_lossy_profile 2024 Jul 11 11:52:37.759116 sonic ERR swss#orchagent: :- processPriorityGroup: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:37.759159 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:37.759159 sonic NOTICE swss#orchagent: :- processPriorityGroup: Set buffer PG Ethernet107:0 to BUFFER_PROFILE_TABLE:ingress_lossy_profile 2024 Jul 11 11:52:37.759250 sonic ERR swss#orchagent: :- processPriorityGroup: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:37.759250 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:37.762790 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet104:0-2 to BUFFER_PROFILE_TABLE:egress_lossy_profile 2024 Jul 11 11:52:37.762888 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet104 not found 2024 Jul 11 11:52:37.762888 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:37.762888 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet104:3-4 to BUFFER_PROFILE_TABLE:egress_lossless_profile 2024 Jul 11 11:52:37.762962 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet104 not found 2024 Jul 11 11:52:37.762962 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:37.762962 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet104:5-6 to BUFFER_PROFILE_TABLE:egress_lossy_profile 2024 Jul 11 11:52:37.763006 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet104 not found 2024 Jul 11 11:52:37.763006 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:37.763028 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet105:0-2 to BUFFER_PROFILE_TABLE:egress_lossy_profile 2024 Jul 11 11:52:37.763028 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:37.763081 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task

2024 Jul 11 11:52:38.461206 sonic ERR swss#orchagent: :- handlePortQosMapTable: Failed to apply QoS maps to port Ethernet105. Port is not found. 2024 Jul 11 11:52:38.461288 sonic NOTICE swss#orchagent: :- handlePortQosMapTable: Applied QoS maps to ports 2024 Jul 11 11:52:38.461424 sonic ERR swss#orchagent: :- handlePortQosMapTable: Failed to apply QoS maps to port Ethernet106. Port is not found. 2024 Jul 11 11:52:38.461495 sonic NOTICE swss#orchagent: :- handlePortQosMapTable: Applied QoS maps to ports 2024 Jul 11 11:52:38.461547 sonic ERR swss#orchagent: :- handlePortQosMapTable: Failed to apply QoS maps to port Ethernet107. Port is not found. 2024 Jul 11 11:52:38.461565 sonic NOTICE swss#orchagent: :- handlePortQosMapTable: Applied QoS maps to ports 2024 Jul 11 11:52:38.619901 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:38.619901 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.619901 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:38.619935 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620099 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:38.620099 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620136 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:38.620136 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620172 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:38.620187 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620212 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:38.620212 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620244 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:38.620257 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620280 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:38.620448 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620464 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:38.620514 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620543 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:38.620543 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620577 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:38.620577 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620614 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:38.620648 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620661 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:38.620687 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620701 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:38.620734 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620734 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:38.620770 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620998 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:38.620998 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620998 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:38.620998 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.620998 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:38.621065 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.621065 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:38.621108 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.621124 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:38.621141 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.621168 sonic ERR swss#orchagent: :- handleQueueTable: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:38.621168 sonic ERR swss#orchagent: :- doTask: Failed to process invalid QOS task 2024 Jul 11 11:52:38.622171 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet105:3-4 to BUFFER_PROFILE_TABLE:egress_lossless_profile 2024 Jul 11 11:52:38.622171 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:38.622281 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:38.622300 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet105:5-6 to BUFFER_PROFILE_TABLE:egress_lossy_profile 2024 Jul 11 11:52:38.622320 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet105 not found 2024 Jul 11 11:52:38.622342 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:38.622358 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet106:0-2 to BUFFER_PROFILE_TABLE:egress_lossy_profile 2024 Jul 11 11:52:38.622377 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:38.622398 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:38.622637 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet106:3-4 to BUFFER_PROFILE_TABLE:egress_lossless_profile 2024 Jul 11 11:52:38.622637 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:38.622637 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:38.622637 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet106:5-6 to BUFFER_PROFILE_TABLE:egress_lossy_profile 2024 Jul 11 11:52:38.622637 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet106 not found 2024 Jul 11 11:52:38.622683 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:38.622725 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet107:0-2 to BUFFER_PROFILE_TABLE:egress_lossy_profile 2024 Jul 11 11:52:38.622725 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:38.622725 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:38.622865 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet107:3-4 to BUFFER_PROFILE_TABLE:egress_lossless_profile 2024 Jul 11 11:52:38.622865 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:38.622865 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task 2024 Jul 11 11:52:38.622865 sonic NOTICE swss#orchagent: :- processQueue: Set buffer queue Ethernet107:5-6 to BUFFER_PROFILE_TABLE:egress_lossy_profile 2024 Jul 11 11:52:38.622932 sonic ERR swss#orchagent: :- processQueue: Port with alias:Ethernet107 not found 2024 Jul 11 11:52:38.622932 sonic ERR swss#orchagent: :- doTask: Failed to process invalid buffer task

syslog snippet for port creation:

2024 Jul 11 11:52:39.650493 sonic NOTICE swss#orchagent: :- addPortBulk: Created ports: 281474976717295 2024 Jul 11 11:52:40.692926 sonic NOTICE swss#orchagent: :- addPortBulk: Created ports: 281474976717338 2024 Jul 11 11:52:41.777504 sonic NOTICE swss#orchagent: :- addPortBulk: Created ports: 281474976717381