search

sonic-net / sonic-buildimage

Scripts which perform an installable binary image build for SONiC
Other
711 stars 1.36k forks source link

[DPB] Port Breakout issue on Mellanox SN2700 #9478

Closed tw0byt3 closed 1 year ago

tw0byt3 commented 2 years ago

root@localhost:~# config interface breakout Ethernet0 4x10G[25G] Do you want to Breakout the port, continue? [y/N]: y

Running Breakout Mode : 1x100G[50G,40G,25G,10G] Target Breakout Mode : 4x10G[25G]

Ports to be deleted : { "Ethernet0": "100000" } Ports to be added : { "Ethernet0": "10000", "Ethernet1": "10000", "Ethernet2": "10000", "Ethernet3": "10000" }

After running Logic to limit the impact

Final list of ports to be deleted : { "Ethernet0": "100000" } Final list of ports to be added : { "Ethernet0": "10000", "Ethernet1": "10000", "Ethernet2": "10000", "Ethernet3": "10000" } Note: Below table(s) have no YANG models: KDUMP, SNMP, SNMP_COMMUNITY, XCVRD_LOG, Below Config can not be verified, It may cause harm to the system {} Do you wish to Continue? [y/N]: y Create Config to load in DB, Failed 'str' object has no attribute 'append' Config Diff Generation failed 'str' object has no attribute 'append' 'str' object has no attribute 'append' Port Deletion Failed [ERROR] Port breakout Failed!!! Opting Out Failed to break out Port. Error:

Can someone help me identity there is this str object?

dgsudharsan commented 2 years ago

@tw0byt3 Can you provide more information like tech support and version where it is reported?

dgsudharsan commented 2 years ago

@praveen-li @zhenggen-xu FYI can you please look? I believe it might be related to the DPB infra as I don't see it has anything to do with platform specific portion.

tw0byt3 commented 2 years ago

@dgsudharsan The below is the output of show version

SONiC Software Version: SONiC.ssdev2 Distribution: Debian 11.1 Kernel: 5.10.0-8-2-amd64 Build commit: f2ee94d20 Build date: Mon Dec 6 16:19:57 UTC 2021 Built by: st@sv-s18

Platform: x86_64-mlnx_msn2700-r0 HwSKU: ACS-MSN2700 ASIC: mellanox ASIC Count: 1 Serial Number: MT2017T06730 Model Number: MSN2700-CS2ROS Hardware Revision: A2 Uptime: 06:01:36 up 17:02, 1 user, load average: 0.41, 0.52, 0.45

Docker images: REPOSITORY TAG IMAGE ID SIZE docker-fpm-frr latest 58fefba9966a 455MB docker-fpm-frr ssdev2 58fefba9966a 455MB docker-platform-monitor latest f440d870506c 802MB docker-platform-monitor ssdev2 f440d870506c 802MB docker-dhcp-relay latest 43a01c86a07a 437MB docker-orchagent latest 9dcbac772f00 455MB docker-orchagent ssdev2 9dcbac772f00 455MB docker-snmp latest dda63c84c916 465MB docker-snmp ssdev2 dda63c84c916 465MB docker-sflow latest 44de0c5d6e2e 437MB docker-sflow ssdev2 44de0c5d6e2e 437MB docker-macsec latest 29bcfdbfd384 440MB docker-macsec ssdev2 29bcfdbfd384 440MB docker-teamd latest a1ac71a8b2c9 436MB docker-teamd ssdev2 a1ac71a8b2c9 436MB docker-syncd-mlnx latest 920bbb2cc3fe 1GB docker-syncd-mlnx ssdev2 920bbb2cc3fe 1GB docker-lldp latest 1a25e8466e28 463MB docker-lldp ssdev2 1a25e8466e28 463MB docker-sonic-mgmt-framework latest 6aac77101af6 578MB docker-sonic-mgmt-framework ssdev2 6aac77101af6 578MB docker-database latest daf79a05a491 423MB docker-database ssdev2 daf79a05a491 423MB docker-mux latest 96a7a97c0f06 475MB docker-mux ssdev2 96a7a97c0f06 475MB docker-router-advertiser latest 86f8e60dd323 423MB docker-router-advertiser ssdev2 86f8e60dd323 423MB

dgsudharsan commented 2 years ago

Thanks. Can you also add techsupport information?

tw0byt3 commented 2 years ago

@dgsudharsan I am sorry but I was unable to share the .zip file over here. Can you let me know what is needed and how I can share the same with you?

dgsudharsan commented 2 years ago

@tw0byt3 Can you then attach your configuration file here? We will try to recreate locally.

dgsudharsan commented 2 years ago

@tw0byt3 Looks like many others with different platforms are reporting the same. https://groups.google.com/g/sonicproject/c/uqnUtplY-PI

@zhenggen-xu @praveen-li I believe this is a generic DPB infra related issue. Could you please help here?

praveen-li commented 2 years ago

Kindly provide the config. Kindly run the breakout command in verbose mode and provide syslogs.

mykolaxgerasymenko commented 2 years ago

I was trying to do DPB on the sonic was built two days ago with my fix PR #9418 and it works correctly.

mykolaxgerasymenko commented 2 years ago

The problem is fixed by adding sonic-types to sonic-flex_counter yang model: https://github.com/Azure/sonic-buildimage/blob/master/src/sonic-yang-models/yang-models/sonic-flex_counter.yang#L8 and changing the type to stypes:boolean_type for typedef flex_delay_status: https://github.com/Azure/sonic-buildimage/blob/master/src/sonic-yang-models/yang-models/sonic-flex_counter.yang#L31 It worked for me.

tw0byt3 commented 2 years ago

@dgsudharsan @praveen-li Config DB: { "DEVICE_METADATA": { "localhost": { "hwsku": "ACS-MSN2700", "platform": "x86_64-mlnx_msn2700-r0", "mac": "1C:34:DA:9C:08:C0" } }, "PORT": { "Ethernet0": { "alias": "etp1", "lanes": "0,1,2,3", "speed": "100000", "index": "1", "admin_status": "up" }, "Ethernet4": { "alias": "etp2", "lanes": "4,5,6,7", "speed": "100000", "index": "2", "admin_status": "up" }, "Ethernet8": { "alias": "etp3", "lanes": "8,9,10,11", "speed": "100000", "index": "3", "admin_status": "up" }, "Ethernet12": { "alias": "etp4", "lanes": "12,13,14,15", "speed": "100000", "index": "4", "admin_status": "up" }, "Ethernet16": { "alias": "etp5", "lanes": "16,17,18,19", "speed": "100000", "index": "5", "admin_status": "up" }, "Ethernet20": { "alias": "etp6", "lanes": "20,21,22,23", "speed": "100000", "index": "6", "admin_status": "up" }, "Ethernet24": { "alias": "etp7", "lanes": "24,25,26,27", "speed": "100000", "index": "7", "admin_status": "up" }, "Ethernet28": { "alias": "etp8", "lanes": "28,29,30,31", "speed": "100000", "index": "8", "admin_status": "up" }, "Ethernet32": { "alias": "etp9", "lanes": "32,33,34,35", "speed": "100000", "index": "9", "admin_status": "up" }, "Ethernet36": { "alias": "etp10", "lanes": "36,37,38,39", "speed": "100000", "index": "10", "admin_status": "up" }, "Ethernet40": { "alias": "etp11", "lanes": "40,41,42,43", "speed": "100000", "index": "11", "admin_status": "up" }, "Ethernet44": { "alias": "etp12", "lanes": "44,45,46,47", "speed": "100000", "index": "12", "admin_status": "up" }, "Ethernet48": { "alias": "etp13", "lanes": "48,49,50,51", "speed": "100000", "index": "13", "admin_status": "up" }, "Ethernet52": { "alias": "etp14", "lanes": "52,53,54,55", "speed": "100000", "index": "14", "admin_status": "up" }, "Ethernet56": { "alias": "etp15", "lanes": "56,57,58,59", "speed": "100000", "index": "15", "admin_status": "up" }, "Ethernet60": { "alias": "etp16", "lanes": "60,61,62,63", "speed": "100000", "index": "16", "admin_status": "up" }, "Ethernet64": { "alias": "etp17", "lanes": "64,65,66,67", "speed": "100000", "index": "17", "admin_status": "up" }, "Ethernet68": { "alias": "etp18", "lanes": "68,69,70,71", "speed": "100000", "index": "18", "admin_status": "up" }, "Ethernet72": { "alias": "etp19", "lanes": "72,73,74,75", "speed": "100000", "index": "19", "admin_status": "up" }, "Ethernet76": { "alias": "etp20", "lanes": "76,77,78,79", "speed": "100000", "index": "20", "admin_status": "up" }, "Ethernet80": { "alias": "etp21", "lanes": "80,81,82,83", "speed": "100000", "index": "21", "admin_status": "up" }, "Ethernet84": { "alias": "etp22", "lanes": "84,85,86,87", "speed": "100000", "index": "22", "admin_status": "up" }, "Ethernet88": { "alias": "etp23", "lanes": "88,89,90,91", "speed": "100000", "index": "23", "admin_status": "up" }, "Ethernet92": { "alias": "etp24", "lanes": "92,93,94,95", "speed": "100000", "index": "24", "admin_status": "up" }, "Ethernet96": { "alias": "etp25", "lanes": "96,97,98,99", "speed": "100000", "index": "25", "admin_status": "up" }, "Ethernet100": { "alias": "etp26", "lanes": "100,101,102,103", "speed": "100000", "index": "26", "admin_status": "up" }, "Ethernet104": { "alias": "etp27", "lanes": "104,105,106,107", "speed": "100000", "index": "27", "admin_status": "up" }, "Ethernet108": { "alias": "etp28", "lanes": "108,109,110,111", "speed": "100000", "index": "28", "admin_status": "up" }, "Ethernet112": { "alias": "etp29", "lanes": "112,113,114,115", "speed": "100000", "index": "29", "admin_status": "up" }, "Ethernet116": { "alias": "etp30", "lanes": "116,117,118,119", "speed": "100000", "index": "30", "admin_status": "up" }, "Ethernet120": { "alias": "etp31", "lanes": "120,121,122,123", "speed": "100000", "index": "31", "admin_status": "up" }, "Ethernet124": { "alias": "etp32", "lanes": "124,125,126,127", "speed": "100000", "index": "32", "admin_status": "up" } }, "BREAKOUT_CFG": { "Ethernet0": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet4": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet8": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet12": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet16": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet20": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet24": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet28": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet32": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet36": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet40": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet44": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet48": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet52": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet56": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet60": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet64": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet68": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet72": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet76": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet80": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet84": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet88": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet92": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet96": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet100": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet104": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet108": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet112": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet116": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet120": { "brkout_mode": "1x100G[50G,40G,25G,10G]" }, "Ethernet124": { "brkout_mode": "1x100G[50G,40G,25G,10G]" } }, "FLEX_COUNTER_TABLE": { "ACL": { "FLEX_COUNTER_STATUS": "disable", "FLEX_COUNTER_DELAY_STATUS": "true", "POLL_INTERVAL": "10000" } }, "VLAN": { "Vlan1000": { "vlanid": "1000" } }, "VLAN_MEMBER": { "Vlan1000|Ethernet0": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet4": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet8": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet12": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet16": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet20": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet24": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet28": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet32": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet36": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet40": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet44": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet48": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet52": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet56": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet60": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet64": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet68": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet72": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet76": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet80": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet84": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet88": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet92": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet96": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet100": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet104": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet108": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet112": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet116": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet120": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet124": { "tagging_mode": "untagged" } } }

Output of Breakout :

root@localhost:~# config interface breakout Ethernet0 4x10G[25G] -f -v -y

Running Breakout Mode : 1x100G[50G,40G,25G,10G] Target Breakout Mode : 4x10G[25G]

Ports to be deleted : { "Ethernet0": "100000" } Ports to be added : { "Ethernet0": "10000", "Ethernet1": "10000", "Ethernet2": "10000", "Ethernet3": "10000" }

After running Logic to limit the impact

Final list of ports to be deleted : { "Ethernet0": "100000" } Final list of ports to be added :
{ "Ethernet0": "10000", "Ethernet1": "10000", "Ethernet2": "10000", "Ethernet3": "10000" } sonic_yang(3):Yang Models Load failed:[priority,] message string Yang Models Load failed [priority,] message string ConfigMgmt Class creation failed Failed to break out Port. Error: Failed to load the config. Error: ConfigMgmtDPB Class creation failed

mykolaxgerasymenko commented 2 years ago

@tw0byt3 Is this some other issue? Why logs is different?

tw0byt3 commented 2 years ago

@mykolaxgerasymenko This is the same issue, but the output differs when -v is used for verbose output

mykolaxgerasymenko commented 2 years ago

What is the sonic version did you use for show last logs?

tw0byt3 commented 2 years ago

@mykolaxgerasymenko SONiC Software Version: SONiC.ssdev2 Distribution: Debian 11.1 Kernel: 5.10.0-8-2-amd64 Build commit: f2ee94d20 Build date: Mon Dec 6 16:19:57 UTC 2021 Built by: st@sv-s18

Platform: x86_64-mlnx_msn2700-r0 HwSKU: ACS-MSN2700 ASIC: mellanox ASIC Count: 1 Serial Number: MT2017T06730 Model Number: MSN2700-CS2ROS Hardware Revision: A2 Uptime: 09:53:34 up 3 days, 20:54, 1 user, load average: 0.17, 0.28, 0.27

Docker images: REPOSITORY TAG IMAGE ID SIZE docker-fpm-frr latest 58fefba9966a 455MB docker-fpm-frr ssdev2 58fefba9966a 455MB docker-platform-monitor latest f440d870506c 802MB docker-platform-monitor ssdev2 f440d870506c 802MB docker-dhcp-relay latest 43a01c86a07a 437MB docker-orchagent latest 9dcbac772f00 455MB docker-orchagent ssdev2 9dcbac772f00 455MB docker-snmp latest dda63c84c916 465MB docker-snmp ssdev2 dda63c84c916 465MB docker-sflow latest 44de0c5d6e2e 437MB docker-sflow ssdev2 44de0c5d6e2e 437MB docker-macsec latest 29bcfdbfd384 440MB docker-macsec ssdev2 29bcfdbfd384 440MB docker-teamd latest a1ac71a8b2c9 436MB docker-teamd ssdev2 a1ac71a8b2c9 436MB docker-syncd-mlnx latest 920bbb2cc3fe 1GB docker-syncd-mlnx ssdev2 920bbb2cc3fe 1GB docker-lldp latest 1a25e8466e28 463MB docker-lldp ssdev2 1a25e8466e28 463MB docker-sonic-mgmt-framework latest 6aac77101af6 578MB docker-sonic-mgmt-framework ssdev2 6aac77101af6 578MB docker-database latest daf79a05a491 423MB docker-database ssdev2 daf79a05a491 423MB docker-mux latest 96a7a97c0f06 475MB docker-mux ssdev2 96a7a97c0f06 475MB docker-router-advertiser latest 86f8e60dd323 423MB docker-router-advertiser ssdev2 86f8e60dd323 423MB

mykolaxgerasymenko commented 2 years ago

@tw0byt3 Could you please try DPB on the latest SONiC image to localize the problem you faced? But just apply the changes from PR #9487 for solve issue with Yang model support for SRV6 CRM.

SONiC Software Version: SONiC.master.58504-dirty-20211211.172134
Distribution: Debian 11.1
Kernel: 5.10.0-8-2-amd64
Build commit: 4803847e5
Build date: Sat Dec 11 17:28:28 UTC 2021
Built by: AzDevOps@sonic-build-workers-000Z3D

But please do not use -v (verbose) option, because with this option I have the same error you showed:

admin@sonic:/usr/local/yang-models$ sudo config interface breakout Ethernet0 2x50G -f -v -y

Running Breakout Mode : 1x100G[40G] 
Target Breakout Mode : 2x50G

Ports to be deleted : 
 {
    "Ethernet0": "100000"
}
Ports to be added : 
 {
    "Ethernet0": "50000",
    "Ethernet2": "50000"
}

After running Logic to limit the impact

Final list of ports to be deleted : 
 {
    "Ethernet0": "100000"
} 
Final list of ports to be added :  
 {
    "Ethernet0": "50000",
    "Ethernet2": "50000"
}
sonic_yang(3):Yang Models Load failed:[priority,] message string
Yang Models Load failed
[priority,] message string
ConfigMgmt Class creation failed
Failed to break out Port. Error: Failed to load the config. Error: ConfigMgmtDPB Class creation failed

Without the -v mode, I got a successful result:

admin@sonic:/usr/local/yang-models$ sudo config interface breakout Ethernet0 2x50G -f -y

Running Breakout Mode : 1x100G[40G] 
Target Breakout Mode : 2x50G

Ports to be deleted : 
 {
    "Ethernet0": "100000"
}
Ports to be added : 
 {
    "Ethernet0": "50000",
    "Ethernet2": "50000"
}

After running Logic to limit the impact

Final list of ports to be deleted : 
 {
    "Ethernet0": "100000"
} 
Final list of ports to be added :  
 {
    "Ethernet0": "50000",
    "Ethernet2": "50000"
}
Note: Below table(s) have no YANG models:
KDUMP, SNMP, SNMP_COMMUNITY, 
Below Config can not be verified, It may cause harm to the system
 {}
Do you wish to Continue? [y/N]: y
Breakout process got successfully completed.
Please note loaded setting will be lost after system reboot. To preserve setting, run `config save`.
tw0byt3 commented 2 years ago

@mykolaxgerasymenko I tried the DPB on the latest SONiC image and applied the change from the PR #9487 

SONiC Software Version: SONiC.master.0-dirty-20211213.190818
Distribution: Debian 11.1
Kernel: 5.10.0-8-2-amd64
Build commit: 6402a0226
Build date: Mon Dec 13 20:01:24 UTC 2021
Built by: st@sv-s18

The Output of the Breakout yet remains the same

admin@localhost:/usr/local/yang-models$ sudo config interface breakout Ethernet0 4x10G[25G] -f -y

Running Breakout Mode : 1x100G[50G,40G,25G,10G] 
Target Breakout Mode : 4x10G[25G]

Ports to be deleted : 
 {
    "Ethernet0": "100000"
}
Ports to be added : 
 {
    "Ethernet0": "10000",
    "Ethernet1": "10000",
    "Ethernet2": "10000",
    "Ethernet3": "10000"
}

After running Logic to limit the impact

Final list of ports to be deleted : 
 {
    "Ethernet0": "100000"
} 
Final list of ports to be added :  
 {
    "Ethernet0": "10000",
    "Ethernet1": "10000",
    "Ethernet2": "10000",
    "Ethernet3": "10000"
}
Note: Below table(s) have no YANG models:
KDUMP, XCVRD_LOG, 
Below Config can not be verified, It may cause harm to the system
 {}
Do you wish to Continue? [y/N]: y
Create Config to load in DB, Failed
'str' object has no attribute 'append'
Config Diff Generation failed
'str' object has no attribute 'append'
'str' object has no attribute 'append'
Port Deletion Failed
[ERROR] Port breakout Failed!!! Opting Out
Failed to break out Port. Error:

I also see that a new_port_config.json file is created in the root user home directory post the command is entered and file includes this:

Screenshot from 2021-12-14 02-07-21

mbze430 commented 2 years ago

I am having the same exact problem on a broadcom Celestica DX010. Should I open a new bug report or post mine here? I posted this on the Google Forum as well but no one answered from there

admin@dx010:~$ show version

SONiC Software Version: SONiC.202106.57766-e2b8e2d1d
Distribution: Debian 10.11
Kernel: 4.19.0-12-2-amd64
Build commit: e2b8e2d1d
Build date: Wed Dec  8 17:11:08 UTC 2021
Built by: AzDevOps@sonic-build-workers-000YSN

Platform: x86_64-cel_seastone-r0
HwSKU: Seastone-DX010
ASIC: broadcom
ASIC Count: 1
Serial Number: DX010B2F108423LK100045
Model Number: R0872-F0010-01
Hardware Revision: N/A
Uptime: 02:56:28 up 2 days,  9:59,  1 user,  load average: 1.01, 0.92, 1.05

Docker images:
REPOSITORY                    TAG                      IMAGE ID            SIZE
docker-dhcp-relay             latest                   96fe9f328ca6        428MB
docker-platform-monitor       202106.57766-e2b8e2d1d   46b2c81ae323        636MB
docker-platform-monitor       latest                   46b2c81ae323        636MB
docker-snmp                   202106.57766-e2b8e2d1d   1c6c64d06bb5        462MB
docker-snmp                   latest                   1c6c64d06bb5        462MB
docker-orchagent              202106.57766-e2b8e2d1d   647b930886d5        451MB
docker-orchagent              latest                   647b930886d5        451MB
docker-fpm-frr                202106.57766-e2b8e2d1d   4eaf5f04fe20        451MB
docker-fpm-frr                latest                   4eaf5f04fe20        451MB
docker-nat                    202106.57766-e2b8e2d1d   4d7952ffc394        435MB
docker-nat                    latest                   4d7952ffc394        435MB
docker-sflow                  202106.57766-e2b8e2d1d   4adc78f7d1d9        433MB
docker-sflow                  latest                   4adc78f7d1d9        433MB
docker-macsec                 202106.57766-e2b8e2d1d   a8caf2d88d49        436MB
docker-macsec                 latest                   a8caf2d88d49        436MB
docker-syncd-brcm             202106.57766-e2b8e2d1d   40ffb870205e        717MB
docker-syncd-brcm             latest                   40ffb870205e        717MB
docker-sonic-mgmt-framework   202106.57766-e2b8e2d1d   4615dec8f36c        576MB
docker-sonic-mgmt-framework   latest                   4615dec8f36c        576MB
docker-teamd                  202106.57766-e2b8e2d1d   1544a4170ea9        432MB
docker-teamd                  latest                   1544a4170ea9        432MB
docker-router-advertiser      202106.57766-e2b8e2d1d   8c0c464e5db5        421MB
docker-router-advertiser      latest                   8c0c464e5db5        421MB
docker-lldp                   202106.57766-e2b8e2d1d   499f4a39da20        461MB
docker-lldp                   latest                   499f4a39da20        461MB
docker-sonic-telemetry        202106.57766-e2b8e2d1d   1bc7246fe59f        509MB
docker-sonic-telemetry        latest                   1bc7246fe59f        509MB
docker-database               202106.57766-e2b8e2d1d   e986c6f35b4c        421MB
docker-database               latest                   e986c6f35b4c        421MB
admin@dx010:~$ sudo config interface breakout Ethernet112 4x25G[10G]

Running Breakout Mode : 1x100G[40G]
Target Breakout Mode : 4x25G[10G]

Ports to be deleted :
 {
    "Ethernet112": "100000"
}
Ports to be added :
 {
    "Ethernet112": "25000",
    "Ethernet113": "25000",
    "Ethernet114": "25000",
    "Ethernet115": "25000"
}

After running Logic to limit the impact

Final list of ports to be deleted :
 {
    "Ethernet112": "100000"
}
Final list of ports to be added :
 {
    "Ethernet112": "25000",
    "Ethernet113": "25000",
    "Ethernet114": "25000",
    "Ethernet115": "25000"
}
Note: Below table(s) have no YANG models:
FEATURE, KDUMP, SNMP, SNMP_COMMUNITY, XCVRD_LOG,
Below Config can not be verified, It may cause harm to the system
 {}
Do you wish to Continue? [y/N]: y
Create Config to load in DB, Failed
'str' object has no attribute 'append'
Config Diff Generation failed
'str' object has no attribute 'append'
'str' object has no attribute 'append'
Port Deletion Failed
[ERROR] Port breakout Failed!!! Opting Out
Failed to break out Port. Error:
Dec 14 03:33:25.939699 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on eth0 (d0:67:e5:d0:51:47)
Dec 14 03:33:25.940087 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet116 (00:07:43:49:9e:67)
Dec 14 03:33:25.940707 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet117 (00:07:43:49:9e:6f)
Dec 14 03:33:25.941355 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet118 (00:07:43:49:9e:77)
Dec 14 03:33:25.942036 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet119 (00:07:43:49:9e:7f)
Dec 14 03:33:25.942517 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet124 (d0:67:e5:d0:51:47)
Dec 14 03:33:27.984899 dx010 INFO ConfigMgmt: delPorts ports:['Ethernet112'] force:False
Dec 14 03:33:27.985235 dx010 INFO ConfigMgmt: Start Port Deletion
Dec 14 03:33:27.985451 dx010 INFO ConfigMgmt: Find dependecies for port Ethernet112
Dec 14 03:33:27.989061 dx010 INFO ConfigMgmt: Deleting Port: Ethernet112
Dec 14 03:33:27.998052 dx010 INFO ConfigMgmt: Data Validation successful
Dec 14 03:33:28.001818 dx010 INFO sonic_yang: revXlateYangtoConfigDB BREAKOUT_CFG
Dec 14 03:33:28.002103 dx010 INFO sonic_yang: revXlateListInContainer BREAKOUT_CFG_LIST
Dec 14 03:33:28.002814 dx010 INFO sonic_yang: revXlateYangtoConfigDB CRM
Dec 14 03:33:28.003053 dx010 INFO sonic_yang: revXlateContainerInContainer Config
Dec 14 03:33:28.003691 dx010 INFO sonic_yang: revXlateYangtoConfigDB DEVICE_METADATA
Dec 14 03:33:28.004029 dx010 INFO sonic_yang: revXlateContainerInContainer localhost
Dec 14 03:33:28.004317 dx010 INFO sonic_yang: revXlateYangtoConfigDB FLEX_COUNTER_TABLE
Dec 14 03:33:28.004590 dx010 INFO sonic_yang: revXlateContainerInContainer BUFFER_POOL_WATERMARK
Dec 14 03:33:28.004879 dx010 INFO sonic_yang: revXlateContainerInContainer PFCWD
Dec 14 03:33:28.005150 dx010 INFO sonic_yang: revXlateContainerInContainer PG_DROP
Dec 14 03:33:28.005424 dx010 INFO sonic_yang: revXlateContainerInContainer PG_WATERMARK
Dec 14 03:33:28.005697 dx010 INFO sonic_yang: revXlateContainerInContainer PORT
Dec 14 03:33:28.005980 dx010 INFO sonic_yang: revXlateContainerInContainer PORT_BUFFER_DROP
Dec 14 03:33:28.006248 dx010 INFO sonic_yang: revXlateContainerInContainer QUEUE
Dec 14 03:33:28.006510 dx010 INFO sonic_yang: revXlateContainerInContainer QUEUE_WATERMARK
Dec 14 03:33:28.006771 dx010 INFO sonic_yang: revXlateContainerInContainer RIF
Dec 14 03:33:28.007044 dx010 INFO sonic_yang: revXlateYangtoConfigDB LOOPBACK_INTERFACE
Dec 14 03:33:28.007312 dx010 INFO sonic_yang: revXlateListInContainer LOOPBACK_INTERFACE_LIST
Dec 14 03:33:28.007578 dx010 INFO sonic_yang: revXlateListInContainer LOOPBACK_INTERFACE_IPPREFIX_LIST
Dec 14 03:33:28.007878 dx010 INFO sonic_yang: revXlateYangtoConfigDB PORT
Dec 14 03:33:28.008160 dx010 INFO sonic_yang: revXlateListInContainer PORT_LIST
Dec 14 03:33:28.008434 dx010 INFO sonic_yang: revXlateYangtoConfigDB VERSIONS
Dec 14 03:33:28.008722 dx010 INFO sonic_yang: revXlateContainerInContainer DATABASE
Dec 14 03:33:28.008994 dx010 INFO sonic_yang: revXlateYangtoConfigDB VLAN
Dec 14 03:33:28.009318 dx010 INFO sonic_yang: revXlateListInContainer VLAN_LIST
Dec 14 03:33:28.009586 dx010 INFO sonic_yang: revXlateYangtoConfigDB VLAN_INTERFACE
Dec 14 03:33:28.009848 dx010 INFO sonic_yang: revXlateListInContainer VLAN_INTERFACE_LIST
Dec 14 03:33:28.010124 dx010 INFO sonic_yang: revXlateListInContainer VLAN_INTERFACE_IPPREFIX_LIST
Dec 14 03:33:28.010405 dx010 INFO sonic_yang: revXlateYangtoConfigDB VLAN_MEMBER
Dec 14 03:33:28.010670 dx010 INFO sonic_yang: revXlateListInContainer VLAN_MEMBER_LIST
Dec 14 03:33:28.010946 dx010 INFO ConfigMgmt: Generate Final Config to write in DB
Dec 14 03:33:28.015402 dx010 ERR ConfigMgmt: Create Config to load in DB, Failed
Dec 14 03:33:28.017288 dx010 ERR ConfigMgmt: 'str' object has no attribute 'append'
Dec 14 03:33:28.017513 dx010 ERR ConfigMgmt: Config Diff Generation failed
Dec 14 03:33:28.017741 dx010 ERR ConfigMgmt: 'str' object has no attribute 'append'
Dec 14 03:33:28.017961 dx010 ERR ConfigMgmt: 'str' object has no attribute 'append'
Dec 14 03:33:28.018171 dx010 ERR ConfigMgmt: Port Deletion Failed
Dec 14 03:33:32.528790 dx010 INFO sonic_yang: module: sonic-acl is loaded successfully
Dec 14 03:33:32.536048 dx010 INFO sonic_yang: module: sonic-bgp-common is loaded successfully
Dec 14 03:33:32.539054 dx010 INFO sonic_yang: module: sonic-bgp-global is loaded successfully
Dec 14 03:33:32.543046 dx010 INFO sonic_yang: module: sonic-bgp-neighbor is loaded successfully
Dec 14 03:33:32.543401 dx010 INFO sonic_yang: module: sonic-bgp-peergroup is loaded successfully
Dec 14 03:33:32.543907 dx010 INFO sonic_yang: module: sonic-breakout_cfg is loaded successfully
Dec 14 03:33:32.545913 dx010 INFO sonic_yang: module: sonic-copp is loaded successfully
Dec 14 03:33:32.550646 dx010 INFO sonic_yang: module: sonic-crm is loaded successfully
Dec 14 03:33:32.551583 dx010 INFO sonic_yang: module: sonic-device_metadata is loaded successfully
Dec 14 03:33:32.552317 dx010 INFO sonic_yang: module: sonic-device_neighbor is loaded successfully
Dec 14 03:33:32.552629 dx010 INFO sonic_yang: module: sonic-extension is loaded successfully
Dec 14 03:33:32.553524 dx010 INFO sonic_yang: module: sonic-flex_counter is loaded successfully
Dec 14 03:33:32.554592 dx010 INFO sonic_yang: module: sonic-interface is loaded successfully
Dec 14 03:33:32.555027 dx010 INFO sonic_yang: module: sonic-loopback-interface is loaded successfully
Dec 14 03:33:32.556811 dx010 INFO sonic_yang: module: sonic-mgmt_interface is loaded successfully
Dec 14 03:33:32.557139 dx010 INFO sonic_yang: module: sonic-mgmt_port is loaded successfully
Dec 14 03:33:32.557611 dx010 INFO sonic_yang: module: sonic-mgmt_vrf is loaded successfully
Dec 14 03:33:32.559902 dx010 INFO sonic_yang: module: sonic-nat is loaded successfully
Dec 14 03:33:32.561508 dx010 INFO sonic_yang: module: sonic-ntp is loaded successfully
Dec 14 03:33:32.561900 dx010 INFO sonic_yang: module: sonic-port is loaded successfully
Dec 14 03:33:32.562430 dx010 INFO sonic_yang: module: sonic-portchannel is loaded successfully
Dec 14 03:33:32.563098 dx010 INFO sonic_yang: module: sonic-route-common is loaded successfully
Dec 14 03:33:32.563461 dx010 INFO sonic_yang: module: sonic-route-map is loaded successfully
Dec 14 03:33:32.563774 dx010 INFO sonic_yang: module: sonic-routing-policy-sets is loaded successfully
Dec 14 03:33:32.564353 dx010 INFO sonic_yang: module: sonic-system-aaa is loaded successfully
Dec 14 03:33:32.566496 dx010 INFO sonic_yang: module: sonic-system-tacacs is loaded successfully
Dec 14 03:33:32.566846 dx010 INFO sonic_yang: module: sonic-types is loaded successfully
Dec 14 03:33:32.567289 dx010 INFO sonic_yang: module: sonic-versions is loaded successfully
Dec 14 03:33:32.568859 dx010 INFO sonic_yang: module: sonic-vlan is loaded successfully
Dec 14 03:33:32.569193 dx010 INFO sonic_yang: module: sonic-vrf is loaded successfully
Dec 14 03:33:32.569444 dx010 DEBUG sonic_yang: Loaded below Yang Models
Dec 14 03:33:32.569781 dx010 ERR sonic_yang: Yang Models Load failed:[priority,] message string
Dec 14 03:33:32.570085 dx010 ERR ConfigMgmt: Yang Models Load failed#012[priority,] message string
Dec 14 03:33:32.570308 dx010 ERR ConfigMgmt: ConfigMgmt Class creation failed
Dec 14 03:33:36.027387 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on eth0 (d0:67:e5:d0:51:47)
Dec 14 03:33:36.030082 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet116 (00:07:43:49:9e:67)
Dec 14 03:33:36.030082 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet117 (00:07:43:49:9e:6f)
Dec 14 03:33:36.030166 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet118 (00:07:43:49:9e:77)
Dec 14 03:33:36.030166 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet119 (00:07:43:49:9e:7f)
Dec 14 03:33:36.030203 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet124 (d0:67:e5:d0:51:47)
Dec 14 03:33:37.862541 dx010 INFO syncd#syncd: [none] SAI_API_FDB:_brcm_sai_fdb_event_cb:167 fdbEvent: add (1) for mac D8-28-C9-34-40-01 vid:0x3e8, port:0x82 lagid:0x0 flags:0x10440 flags2:0x0 lag:false station flags 0x0
Dec 14 03:33:46.147259 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on eth0 (d0:67:e5:d0:51:47)
Dec 14 03:33:46.147657 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet116 (00:07:43:49:9e:67)
Dec 14 03:33:46.148011 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet117 (00:07:43:49:9e:6f)
Dec 14 03:33:46.148304 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet118 (00:07:43:49:9e:77)
Dec 14 03:33:46.148502 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet119 (00:07:43:49:9e:7f)
Dec 14 03:33:46.148792 dx010 INFO lldp#lldp-syncd [lldp_syncd] INFO: Failed to get system capabilities on Ethernet124 (d0:67:e5:d0:51:47)
aravindmani-1 commented 2 years ago

Same issue is seen in DellEMC Z9332f platform(ASIC: TH3) as well.

root@sonic:~# config interface breakout Ethernet0 1x100G[40G] -y -f

Running Breakout Mode : 1x400G Target Breakout Mode : 1x100G[40G]

Ports to be deleted : { "Ethernet0": "400000" } Ports to be added : { "Ethernet0": "100000" }

After running Logic to limit the impact

Final list of ports to be deleted : { "Ethernet0": "400000" } Final list of ports to be added : { "Ethernet0": "100000" } Note: Below table(s) have no YANG models: KDUMP, SNMP, SNMP_COMMUNITY, XCVRD_LOG, Below Config can not be verified, It may cause harm to the system {} Do you wish to Continue? [y/N]: y Create Config to load in DB, Failed 'str' object has no attribute 'append' Config Diff Generation failed 'str' object has no attribute 'append' 'str' object has no attribute 'append' Port Deletion Failed [ERROR] Port breakout Failed!!! Opting Out Failed to break out Port. Error: root@sonic:~#

tw0byt3 commented 2 years ago

There are 2 issues which are causing this.

  1. There is a typo in the path of the ConfigDB file in the following py script which runs the breakout - /usr/local/lib/python3.9/dist-packages/config/config_mgmt.py
  2. If your config_db.json has the value of mac under Device Metadata in the upper case, this causes the Config variable in the script to go null, henceforth giving the aforementioned error.

Once these changes are made, the breakout works as expected, but I noticed that the swss container then starts to break. Trying to identify what exactly is causing this issue as of now. Any suggestions would be appriciated.

praveen-li commented 2 years ago

if SWSS supports a config in uppercase\lowercase only, then it should be a constraint in yang models. And config validation must fail.

Need to check if sonic-yang-mgmt changes from upper to lower case. Ideally it should not.

Thanks,

Regards Praveen

From: Sudharsan Dhamal Gopalarathnam @.> Sent: Tuesday, December 14, 2021 7:21 AM To: Azure/sonic-buildimage @.> Cc: Praveen Chaudhary @.>; Assign @.> Subject: Re: [Azure/sonic-buildimage] [DPB] Port Breakout issue on Mellanox SN2700 (Issue #9478)

Assigned #9478https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2Fsonic-buildimage%2Fissues%2F9478&data=04%7C01%7Cpchaudhary%40linkedin.com%7Ccbcb9c47fb5f4e3392bb08d9bf1557fd%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637750920664616294%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=9FR5LosI5w1daJGnL9IestHJiwmkRSDDBlTlh%2F9CXhE%3D&reserved=0 to @praveen-lihttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fpraveen-li&data=04%7C01%7Cpchaudhary%40linkedin.com%7Ccbcb9c47fb5f4e3392bb08d9bf1557fd%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637750920664626251%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=fPoyIpHxsaNMCYBkLWcXYEPQhlB%2FkP%2FabvLPQegLP74%3D&reserved=0.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2Fsonic-buildimage%2Fissues%2F9478%23event-5764971578&data=04%7C01%7Cpchaudhary%40linkedin.com%7Ccbcb9c47fb5f4e3392bb08d9bf1557fd%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637750920664636208%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=xIXIiiLOgy46l9Btc4PzH9QubG8BPK%2BXdeVYT%2BZ8XHE%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAJHZHPPTBYXDL33QQKZKT4TUQ5OFZANCNFSM5JVTVBLA&data=04%7C01%7Cpchaudhary%40linkedin.com%7Ccbcb9c47fb5f4e3392bb08d9bf1557fd%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637750920664636208%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=rGafbQg2dC2bskhCSq3i3yfW5zLRQ3Kqbg4%2FbRibkrM%3D&reserved=0. Triage notifications on the go with GitHub Mobile for iOShttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapps.apple.com%2Fapp%2Fapple-store%2Fid1477376905%3Fct%3Dnotification-email%26mt%3D8%26pt%3D524675&data=04%7C01%7Cpchaudhary%40linkedin.com%7Ccbcb9c47fb5f4e3392bb08d9bf1557fd%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637750920664646168%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=hRCVFh1RFbDrIL7fyOHrWBWFJPkY0BmZiL%2Formksih4%3D&reserved=0 or Androidhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplay.google.com%2Fstore%2Fapps%2Fdetails%3Fid%3Dcom.github.android%26referrer%3Dutm_campaign%253Dnotification-email%2526utm_medium%253Demail%2526utm_source%253Dgithub&data=04%7C01%7Cpchaudhary%40linkedin.com%7Ccbcb9c47fb5f4e3392bb08d9bf1557fd%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637750920664656121%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=43a5Cgs6NNoplCHVkVU8kpxakmfrPv5qtrGoLRL5eSk%3D&reserved=0.

aravindmani-1 commented 2 years ago

config_db used in DellEMC Z9332f: 9332f_config_db.txt

praveen-li commented 2 years ago

@tw0byt3 lets have a quick call, sometime b/w 5-6 P.M or 9-10 P.M PST, We can discuss the code in question to help you debug it faster. It is generic python code and needed no expertise of networking feature as such. Thx.

dgsudharsan commented 2 years ago

@tw0byt3 Please remove Ethernet4 from your configuration if you have to breakout Ethernet0 4x. In 2700 if you need to breakout the first or third port into 4x10G you need to disable the immediate port. Since DPB doesn't have an infra to handle this limitation, we can remove the port from config_db.json (Ethernet4) and perform breakout on Ethernet0.

eg show interfaces status Interface Lanes Speed MTU FEC Alias Vlan Oper Admin Type Asym PFC

Ethernet0 0 10G 9100 N/A etp1a routed down down QSFP+ or later N/A Ethernet1 1 10G 9100 N/A etp1b routed down down N/A N/A Ethernet2 2 10G 9100 N/A etp1c routed down down N/A N/A Ethernet3 3 10G 9100 N/A etp1d routed down down N/A N/A Ethernet8 8,9,10,11 100G 9100 N/A etp3 routed down up QSFP+ or later N/A

mbze430 commented 2 years ago

@tw0byt3 Please remove Ethernet4 from your configuration if you have to breakout Ethernet0 4x. In 2700 if you need to breakout the first or third port into 4x10G you need to disable the immediate port. Since DPB doesn't have an infra to handle this limitation, we can remove the port from config_db.json (Ethernet4) and perform breakout on Ethernet0.

eg show interfaces status Interface Lanes Speed MTU FEC Alias Vlan Oper Admin Type Asym PFC

Ethernet0 0 10G 9100 N/A etp1a routed down down QSFP+ or later N/A Ethernet1 1 10G 9100 N/A etp1b routed down down N/A N/A Ethernet2 2 10G 9100 N/A etp1c routed down down N/A N/A Ethernet3 3 10G 9100 N/A etp1d routed down down N/A N/A Ethernet8 8,9,10,11 100G 9100 N/A etp3 routed down up QSFP+ or later N/A

@dgsudharsan wait are you saying if you breakout Ethernet0 to 4x25G[10G] you lose Ethernet4? That can't be right? On my Celestica DX010 I have Ethernet116-124 all broken out by 4x25G[10G] and it works fine manually when editing for the config_db.json just not automatically; using 'config interface breakout Ethernet0 4x10G[25G]'.

dgsudharsan commented 2 years ago

@tw0byt3 Please remove Ethernet4 from your configuration if you have to breakout Ethernet0 4x. In 2700 if you need to breakout the first or third port into 4x10G you need to disable the immediate port. Since DPB doesn't have an infra to handle this limitation, we can remove the port from config_db.json (Ethernet4) and perform breakout on Ethernet0. eg show interfaces status Interface Lanes Speed MTU FEC Alias Vlan Oper Admin Type Asym PFC Ethernet0 0 10G 9100 N/A etp1a routed down down QSFP+ or later N/A Ethernet1 1 10G 9100 N/A etp1b routed down down N/A N/A Ethernet2 2 10G 9100 N/A etp1c routed down down N/A N/A Ethernet3 3 10G 9100 N/A etp1d routed down down N/A N/A Ethernet8 8,9,10,11 100G 9100 N/A etp3 routed down up QSFP+ or later N/A

wait are you saying if you breakout Ethernet0 to 4x25G[10G] you lose Ethernet4? That can't be right? On my Celestica DX010 I have Ethernet116-124 all broken out by 4x25G[10G] and it works fine manually when editing for the config_db.json just not automatically; using 'config interface breakout Ethernet0 4x10G[25G]'.

@mbze430 This is a specific limitation for Mellanox SN2700 platform.

mbze430 commented 2 years ago

@dgsudharsan Okay, so there is still a possibility that there is a script issue when using the breakout command

dgsudharsan commented 2 years ago

@dgsudharsan Okay, so there is still a possibility that there is a script issue when using the breakout command

There are two issues. First one is when using the MAC in upper case in device metadata. Work around is to change it to lower case. Second is orchagent crash @tw0byt3 mentioned. The issue happens because of a specific hardware limitation of Mellanox SN2700 for which I provided the solution.

Hope this helps.

mbze430 commented 2 years ago

I am personally not a programmer by trait, the part about MAC in upper case is that something I can do? I can provide whatever information if needed to get this resolved, at least on the Celesitca Seastone DX010

dgsudharsan commented 2 years ago

mbze430

@mbze430 In your system please check the file /etc/sonic/config_db.json There will be section like below "DEVICE_METADATA": { "localhost": { "hwsku": "ACS-MSN2700", "platform": "x86_64-mlnx_msn2700-r0", "mac": "1C:34:DA:9C:08:C0" }

Modify the mac value from upper case to lower case (e.g for above "mac" : "1c:34:da:9c:08:c0"). Perform config reload or reboot the system. Execute breakout command. Hopefully this helps.

mbze430 commented 2 years ago

@dgsudharsan awesome, I will give that a whirl tomorrow morning. I will report back

tw0byt3 commented 2 years ago

@praveen-li Sure, we can schedule a call and work on it. You can reach out to me at chintan.mistry@samespace.com for further discussions.

mbze430 commented 2 years ago

@dgsudharsan turns out my config_db.json MAC address is already in lower case:

    "DEVICE_METADATA": {
        "localhost": {
            "bgp_asn": "65100",
            "buffer_model": "traditional",
            "default_bgp_status": "up",
            "default_pfcwd_status": "disable",
            "hostname": "dx010",
            "hwsku": "Seastone-DX010",
            "mac": "00:e0:ec:8a:1a:bb",
            "platform": "x86_64-cel_seastone-r0",
            "type": "LeafRouter"
        }

just for fun I made them UPPER CASE. and did a config reload the result is still the same. Either lower case or upper case it won't breakout the port

dgsudharsan commented 2 years ago

@mbze430 Might be a different problem them. @praveen-li Please help.

zhenggen-xu commented 2 years ago

@mbze430 Can you do breakout with verbose mode like config interface breakout Ethernet0 4x10G[25G] -v then attach the output and syslog. It would be good to share the complete config_db.json file (you can get by sonic-cfggen -d --print-data > config_db.json) so we can see the difference since it worked for someone not the others.

mbze430 commented 2 years ago

@mbze430 Can you do breakout with verbose mode like config interface breakout Ethernet0 4x10G[25G] -v then attach the output and syslog. It would be good to share the complete config_db.json file (you can get by sonic-cfggen -d --print-data > config_db.json) so we can see the difference since it worked for someone not the others. Here are what you asked for, but I am not sure how to get the syslog

admin@dx010:~$ sudo config interface breakout Ethernet0 4x10G[25G] -v Do you want to Breakout the port, continue? [y/N]: y [ERROR] Target mode 4x10G[25G] is not available for the port Ethernet0 Aborted!

admin@dx010:~$ cat /etc/sonic/config_db.json { "BREAKOUT_CFG": { "Ethernet0": { "brkout_mode": "1x100G[40G]" }, "Ethernet4": { "brkout_mode": "1x100G[40G]" }, "Ethernet8": { "brkout_mode": "1x100G[40G]" }, "Ethernet12": { "brkout_mode": "1x100G[40G]" }, "Ethernet16": { "brkout_mode": "1x100G[40G]" }, "Ethernet20": { "brkout_mode": "1x100G[40G]" }, "Ethernet24": { "brkout_mode": "1x100G[40G]" }, "Ethernet28": { "brkout_mode": "1x100G[40G]" }, "Ethernet32": { "brkout_mode": "1x100G[40G]" }, "Ethernet36": { "brkout_mode": "1x100G[40G]" }, "Ethernet40": { "brkout_mode": "1x100G[40G]" }, "Ethernet44": { "brkout_mode": "1x100G[40G]" }, "Ethernet48": { "brkout_mode": "1x100G[40G]" }, "Ethernet52": { "brkout_mode": "1x100G[40G]" }, "Ethernet56": { "brkout_mode": "1x100G[40G]" }, "Ethernet60": { "brkout_mode": "1x100G[40G]" }, "Ethernet64": { "brkout_mode": "1x100G[40G]" }, "Ethernet68": { "brkout_mode": "1x100G[40G]" }, "Ethernet72": { "brkout_mode": "1x100G[40G]" }, "Ethernet76": { "brkout_mode": "1x100G[40G]" }, "Ethernet80": { "brkout_mode": "1x100G[40G]" }, "Ethernet84": { "brkout_mode": "1x100G[40G]" }, "Ethernet88": { "brkout_mode": "1x100G[40G]" }, "Ethernet92": { "brkout_mode": "1x100G[40G]" }, "Ethernet96": { "brkout_mode": "1x100G[40G]" }, "Ethernet100": { "brkout_mode": "1x100G[40G]" }, "Ethernet104": { "brkout_mode": "1x100G[40G]" }, "Ethernet108": { "brkout_mode": "1x100G[40G]" }, "Ethernet112": { "brkout_mode": "4x25G[10G]" }, "Ethernet116": { "brkout_mode": "4x25G[10G]" }, "Ethernet120": { "brkout_mode": "4x25G[10G]" }, "Ethernet124": { "brkout_mode": "4x25G[10G]" } }, "CRM": { "Config": { "acl_counter_high_threshold": "85", "acl_counter_low_threshold": "70", "acl_counter_threshold_type": "percentage", "acl_entry_high_threshold": "85", "acl_entry_low_threshold": "70", "acl_entry_threshold_type": "percentage", "acl_group_high_threshold": "85", "acl_group_low_threshold": "70", "acl_group_threshold_type": "percentage", "acl_table_high_threshold": "85", "acl_table_low_threshold": "70", "acl_table_threshold_type": "percentage", "dnat_entry_high_threshold": "85", "dnat_entry_low_threshold": "70", "dnat_entry_threshold_type": "percentage", "fdb_entry_high_threshold": "85", "fdb_entry_low_threshold": "70", "fdb_entry_threshold_type": "percentage", "ipmc_entry_high_threshold": "85", "ipmc_entry_low_threshold": "70", "ipmc_entry_threshold_type": "percentage", "ipv4_neighbor_high_threshold": "85", "ipv4_neighbor_low_threshold": "70", "ipv4_neighbor_threshold_type": "percentage", "ipv4_nexthop_high_threshold": "85", "ipv4_nexthop_low_threshold": "70", "ipv4_nexthop_threshold_type": "percentage", "ipv4_route_high_threshold": "85", "ipv4_route_low_threshold": "70", "ipv4_route_threshold_type": "percentage", "ipv6_neighbor_high_threshold": "85", "ipv6_neighbor_low_threshold": "70", "ipv6_neighbor_threshold_type": "percentage", "ipv6_nexthop_high_threshold": "85", "ipv6_nexthop_low_threshold": "70", "ipv6_nexthop_threshold_type": "percentage", "ipv6_route_high_threshold": "85", "ipv6_route_low_threshold": "70", "ipv6_route_threshold_type": "percentage", "mpls_inseg_high_threshold": "85", "mpls_inseg_low_threshold": "70", "mpls_inseg_threshold_type": "percentage", "mpls_nexthop_high_threshold": "85", "mpls_nexthop_low_threshold": "70", "mpls_nexthop_threshold_type": "percentage", "nexthop_group_high_threshold": "85", "nexthop_group_low_threshold": "70", "nexthop_group_member_high_threshold": "85", "nexthop_group_member_low_threshold": "70", "nexthop_group_member_threshold_type": "percentage", "nexthop_group_threshold_type": "percentage", "polling_interval": "300", "snat_entry_high_threshold": "85", "snat_entry_low_threshold": "70", "snat_entry_threshold_type": "percentage" } }, "DEVICE_METADATA": { "localhost": { "bgp_asn": "65100", "buffer_model": "traditional", "default_bgp_status": "up", "default_pfcwd_status": "disable", "hostname": "dx010", "hwsku": "Seastone-DX010", "mac": "00:e0:ec:8a:1a:bb", "platform": "x86_64-cel_seastone-r0", "type": "LeafRouter" } }, "FEATURE": { "bgp": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "True", "has_timer": "False", "high_mem_alert": "disabled", "state": "enabled" }, "database": { "auto_restart": "always_enabled", "has_global_scope": "True", "has_per_asic_scope": "True", "has_timer": "False", "high_mem_alert": "disabled", "state": "always_enabled" }, "dhcp_relay": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "False", "has_timer": "False", "high_mem_alert": "disabled", "set_owner": "local", "state": "enabled" }, "lldp": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "True", "has_timer": "False", "high_mem_alert": "disabled", "state": "enabled" }, "macsec": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "False", "has_timer": "False", "high_mem_alert": "disabled", "state": "disabled" }, "mgmt-framework": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "False", "has_timer": "True", "high_mem_alert": "disabled", "state": "enabled" }, "nat": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "False", "has_timer": "False", "high_mem_alert": "disabled", "state": "disabled" }, "pmon": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "False", "has_timer": "False", "high_mem_alert": "disabled", "state": "enabled" }, "radv": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "False", "has_timer": "False", "high_mem_alert": "disabled", "state": "enabled" }, "sflow": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "False", "has_timer": "False", "high_mem_alert": "disabled", "state": "disabled" }, "snmp": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "False", "has_timer": "True", "high_mem_alert": "disabled", "state": "enabled" }, "swss": { "auto_restart": "enabled", "has_global_scope": "False", "has_per_asic_scope": "True", "has_timer": "False", "high_mem_alert": "disabled", "state": "enabled" }, "syncd": { "auto_restart": "enabled", "has_global_scope": "False", "has_per_asic_scope": "True", "has_timer": "False", "high_mem_alert": "disabled", "state": "enabled" }, "teamd": { "auto_restart": "enabled", "has_global_scope": "False", "has_per_asic_scope": "True", "has_timer": "False", "high_mem_alert": "disabled", "state": "enabled" }, "telemetry": { "auto_restart": "enabled", "has_global_scope": "True", "has_per_asic_scope": "False", "has_timer": "True", "high_mem_alert": "disabled", "state": "enabled" } }, "FLEX_COUNTER_TABLE": { "BUFFER_POOL_WATERMARK": { "FLEX_COUNTER_DELAY_STATUS": "true", "FLEX_COUNTER_STATUS": "enable" }, "PFCWD": { "FLEX_COUNTER_DELAY_STATUS": "true", "FLEX_COUNTER_STATUS": "enable" }, "PG_DROP": { "FLEX_COUNTER_DELAY_STATUS": "true", "FLEX_COUNTER_STATUS": "enable" }, "PG_WATERMARK": { "FLEX_COUNTER_DELAY_STATUS": "true", "FLEX_COUNTER_STATUS": "enable" }, "PORT": { "FLEX_COUNTER_DELAY_STATUS": "true", "FLEX_COUNTER_STATUS": "enable" }, "PORT_BUFFER_DROP": { "FLEX_COUNTER_DELAY_STATUS": "true", "FLEX_COUNTER_STATUS": "enable" }, "QUEUE": { "FLEX_COUNTER_DELAY_STATUS": "true", "FLEX_COUNTER_STATUS": "enable" }, "QUEUE_WATERMARK": { "FLEX_COUNTER_DELAY_STATUS": "true", "FLEX_COUNTER_STATUS": "enable" }, "RIF": { "FLEX_COUNTER_DELAY_STATUS": "true", "FLEX_COUNTER_STATUS": "enable" } }, "KDUMP": { "config": { "enabled": "false", "memory": "0M-2G:256M,2G-4G:320M,4G-8G:384M,8G-:448M", "num_dumps": "3" } }, "LOOPBACK_INTERFACE": { "Loopback0": {}, "Loopback0|10.0.0.1/32": {} }, "NTP_SERVER": { "209.51.161.238": {} }, "PORT": { "Ethernet0": { "admin_status": "up", "alias": "Eth1", "index": "1", "lanes": "65,66,67,68", "mtu": "9100", "speed": "100000" }, "Ethernet4": { "admin_status": "up", "alias": "Eth2", "index": "2", "lanes": "69,70,71,72", "mtu": "9100", "speed": "100000" }, "Ethernet8": { "admin_status": "up", "alias": "Eth3", "index": "3", "lanes": "73,74,75,76", "mtu": "9100", "speed": "100000" }, "Ethernet12": { "admin_status": "up", "alias": "Eth4", "index": "4", "lanes": "77,78,79,80", "mtu": "9100", "speed": "100000" }, "Ethernet16": { "admin_status": "up", "alias": "Eth5", "index": "5", "lanes": "33,34,35,36", "mtu": "9100", "speed": "100000" }, "Ethernet20": { "admin_status": "up", "alias": "Eth6", "index": "6", "lanes": "37,38,39,40", "mtu": "9100", "speed": "100000" }, "Ethernet24": { "admin_status": "up", "alias": "Eth7", "index": "7", "lanes": "41,42,43,44", "mtu": "9100", "speed": "100000" }, "Ethernet28": { "admin_status": "up", "alias": "Eth8", "index": "8", "lanes": "45,46,47,48", "mtu": "9100", "speed": "100000" }, "Ethernet32": { "admin_status": "up", "alias": "Eth9", "index": "9", "lanes": "49,50,51,52", "mtu": "9100", "speed": "100000" }, "Ethernet36": { "admin_status": "up", "alias": "Eth10", "index": "10", "lanes": "53,54,55,56", "mtu": "9100", "speed": "100000" }, "Ethernet40": { "admin_status": "up", "alias": "Eth11", "index": "11", "lanes": "57,58,59,60", "mtu": "9100", "speed": "100000" }, "Ethernet44": { "admin_status": "up", "alias": "Eth12", "index": "12", "lanes": "61,62,63,64", "mtu": "9100", "speed": "100000" }, "Ethernet48": { "admin_status": "up", "alias": "Eth13", "index": "13", "lanes": "81,82,83,84", "mtu": "9100", "speed": "100000" }, "Ethernet52": { "admin_status": "up", "alias": "Eth14", "index": "14", "lanes": "85,86,87,88", "mtu": "9100", "speed": "100000" }, "Ethernet56": { "admin_status": "up", "alias": "Eth15", "index": "15", "lanes": "89,90,91,92", "mtu": "9100", "speed": "100000" }, "Ethernet60": { "admin_status": "up", "alias": "Eth16", "index": "16", "lanes": "93,94,95,96", "mtu": "9100", "speed": "100000" }, "Ethernet64": { "admin_status": "up", "alias": "Eth17", "index": "17", "lanes": "97,98,99,100", "mtu": "9100", "speed": "100000" }, "Ethernet68": { "admin_status": "up", "alias": "Eth18", "index": "18", "lanes": "101,102,103,104", "mtu": "9100", "speed": "100000" }, "Ethernet72": { "admin_status": "up", "alias": "Eth19", "index": "19", "lanes": "105,106,107,108", "mtu": "9100", "speed": "100000" }, "Ethernet76": { "admin_status": "up", "alias": "Eth20", "index": "20", "lanes": "109,110,111,112", "mtu": "9100", "speed": "100000" }, "Ethernet80": { "admin_status": "up", "alias": "Eth21", "index": "21", "lanes": "1,2,3,4", "mtu": "9100", "speed": "100000" }, "Ethernet84": { "admin_status": "up", "alias": "Eth22", "index": "22", "lanes": "5,6,7,8", "mtu": "9100", "speed": "100000" }, "Ethernet88": { "admin_status": "up", "alias": "Eth23", "index": "23", "lanes": "9,10,11,12", "mtu": "9100", "speed": "100000" }, "Ethernet92": { "admin_status": "up", "alias": "Eth24", "index": "24", "lanes": "13,14,15,16", "mtu": "9100", "speed": "100000" }, "Ethernet96": { "admin_status": "up", "alias": "Eth25", "index": "25", "lanes": "17,18,19,20", "mtu": "9100", "speed": "100000" }, "Ethernet100": { "admin_status": "up", "alias": "Eth26", "index": "26", "lanes": "21,22,23,24", "mtu": "9100", "speed": "100000" }, "Ethernet104": { "admin_status": "up", "alias": "Eth27", "index": "27", "lanes": "25,26,27,28", "mtu": "9100", "speed": "40000" }, "Ethernet108": { "admin_status": "up", "alias": "Eth28", "index": "28", "lanes": "29,30,31,32", "mtu": "9100", "speed": "40000" }, "Ethernet112": { "admin_status": "up", "alias": "Eth29/1", "index": "29", "lanes": "113", "mtu": "9100", "speed": "10000" }, "Ethernet113": { "admin_status": "up", "alias": "Eth29/2", "index": "29", "lanes": "114", "mtu": "9100", "speed": "10000" }, "Ethernet114": { "admin_status": "up", "alias": "Eth29/3", "index": "29", "lanes": "115", "mtu": "9100", "speed": "10000" }, "Ethernet115": { "admin_status": "up", "alias": "Eth29/4", "index": "29", "lanes": "116", "mtu": "9100", "speed": "10000" }, "Ethernet116": { "admin_status": "up", "alias": "Eth30/1", "index": "30", "lanes": "117", "speed": "10000" }, "Ethernet117": { "admin_status": "up", "alias": "Eth30/2", "index": "30", "lanes": "118", "speed": "10000" }, "Ethernet118": { "admin_status": "up", "alias": "Eth30/3", "index": "30", "lanes": "119", "speed": "10000" }, "Ethernet119": { "admin_status": "up", "alias": "Eth30/4", "index": "30", "lanes": "120", "speed": "10000" }, "Ethernet120": { "admin_status": "up", "alias": "Eth31/1", "index": "31", "lanes": "121", "speed": "10000" }, "Ethernet121": { "admin_status": "up", "alias": "Eth31/2", "index": "31", "lanes": "122", "speed": "10000" }, "Ethernet122": { "alias": "Eth31/3", "index": "31", "lanes": "123", "speed": "10000" }, "Ethernet123": { "alias": "Eth31/4", "index": "31", "lanes": "124", "speed": "10000" }, "Ethernet124": { "admin_status": "up", "alias": "Eth32/1", "index": "32", "lanes": "125", "speed": "10000" }, "Ethernet125": { "alias": "Eth32/2", "index": "32", "lanes": "126", "speed": "10000" }, "Ethernet126": { "alias": "Eth32/3", "index": "32", "lanes": "127", "speed": "10000" }, "Ethernet127": { "alias": "Eth32/4", "index": "32", "lanes": "128", "speed": "10000" } }, "PORTCHANNEL": { "PortChannel0001": { "admin_status": "up", "lacp_key": "auto", "min_links": "1", "mtu": "9100" } }, "PORTCHANNEL_MEMBER": { "PortChannel0001|Ethernet104": {}, "PortChannel0001|Ethernet108": {} }, "SNMP": { "LOCATION": { "Location": "public" } }, "SNMP_COMMUNITY": { "public": { "TYPE": "RO" } }, "STATIC_ROUTE": { "0.0.0.0/0": { "blackhole": "false", "distance": "0", "ifname": "", "nexthop": "192.168.69.254", "nexthop-vrf": "" } }, "VERSIONS": { "DATABASE": { "VERSION": "version_2_0_2" } }, "VLAN": { "Vlan10": { "vlanid": "10" }, "Vlan11": { "vlanid": "11" }, "Vlan80": { "dhcp_servers": [ "192.168.69.5" ], "vlanid": "80" }, "Vlan90": { "vlanid": "90" }, "Vlan100": { "dhcp_servers": [ "192.168.69.5" ], "vlanid": "100" }, "Vlan110": { "dhcp_servers": [ "192.168.69.5" ], "vlanid": "110" }, "Vlan252": { "vlanid": "252" }, "Vlan253": { "vlanid": "253" }, "Vlan254": { "dhcp_servers": [ "192.168.69.5" ], "vlanid": "254" }, "Vlan1000": { "vlanid": "1000" } }, "VLAN_INTERFACE": { "Vlan80": {}, "Vlan80|10.0.80.254/24": {}, "Vlan90": {}, "Vlan90|10.0.90.254/24": {}, "Vlan100": {}, "Vlan100|10.1.100.254/24": {}, "Vlan110": {}, "Vlan110|10.1.110.254/24": {}, "Vlan253": {}, "Vlan253|10.0.253.254/24": {}, "Vlan254": {}, "Vlan254|10.0.254.254/24": {}, "Vlan1000": {}, "Vlan1000|192.168.69.1/24": {} }, "VLAN_MEMBER": { "Vlan10|Ethernet113": { "tagging_mode": "tagged" }, "Vlan10|Ethernet124": { "tagging_mode": "tagged" }, "Vlan10|PortChannel0001": { "tagging_mode": "tagged" }, "Vlan11|Ethernet117": { "tagging_mode": "untagged" }, "Vlan11|Ethernet124": { "tagging_mode": "tagged" }, "Vlan80|Ethernet124": { "tagging_mode": "tagged" }, "Vlan80|PortChannel0001": { "tagging_mode": "tagged" }, "Vlan100|Ethernet124": { "tagging_mode": "tagged" }, "Vlan110|Ethernet120": { "tagging_mode": "tagged" }, "Vlan110|Ethernet124": { "tagging_mode": "tagged" }, "Vlan252|Ethernet114": { "tagging_mode": "tagged" }, "Vlan252|Ethernet118": { "tagging_mode": "tagged" }, "Vlan252|Ethernet124": { "tagging_mode": "tagged" }, "Vlan253|Ethernet124": { "tagging_mode": "tagged" }, "Vlan254|Ethernet120": { "tagging_mode": "tagged" }, "Vlan254|Ethernet124": { "tagging_mode": "tagged" }, "Vlan254|PortChannel0001": { "tagging_mode": "tagged" }, "Vlan1000|Ethernet4": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet8": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet12": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet16": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet20": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet24": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet28": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet32": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet36": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet40": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet44": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet48": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet52": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet56": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet60": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet64": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet68": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet72": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet76": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet80": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet84": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet88": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet92": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet96": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet100": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet112": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet115": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet116": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet120": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet122": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet123": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet124": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet125": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet126": { "tagging_mode": "untagged" }, "Vlan1000|Ethernet127": { "tagging_mode": "untagged" }, "Vlan1000|PortChannel0001": { "tagging_mode": "untagged" } }, "XCVRD_LOG": { "Y_CABLE": { "enable_log": "false" } }

TyagiShailesh commented 2 years ago

Hi Folks —

Any update on this? We tried it on the latest 202106 Mellanox build but still no luck.

Kindly see the version info and the error below:

admin@r2:~$ show version

SONiC Software Version: SONiC.202106.62230-1aa225cd0 Distribution: Debian 10.11 Kernel: 4.19.0-12-2-amd64 Build commit: 1aa225cd0 Build date: Thu Dec 30 14:12:30 UTC 2021 Built by: AzDevOps@sonic-build-workers-0010XR

Platform: x86_64-mlnx_msn2700-r0 HwSKU: ACS-MSN2700 ASIC: mellanox ASIC Count: 1 Serial Number: MT2004J12764 Model Number: MSN2700-CS2ROS Hardware Revision: A2 Uptime: 14:00:56 up 20 min, 1 user, load average: 0.51, 0.85, 1.01

Docker images: REPOSITORY TAG IMAGE ID SIZE docker-syncd-mlnx 202106.62230-1aa225cd0 f9a5fc77cf45 1GB docker-syncd-mlnx latest f9a5fc77cf45 1GB docker-platform-monitor 202106.62230-1aa225cd0 fa24426929c5 754MB docker-platform-monitor latest fa24426929c5 754MB docker-dhcp-relay latest 87ae55dfc12a 428MB docker-nat 202106.62230-1aa225cd0 c3f0a203e748 435MB docker-nat latest c3f0a203e748 435MB docker-teamd 202106.62230-1aa225cd0 b683b8b7d4b6 433MB docker-teamd latest b683b8b7d4b6 433MB docker-router-advertiser 202106.62230-1aa225cd0 517a564eebbf 421MB docker-router-advertiser latest 517a564eebbf 421MB docker-snmp 202106.62230-1aa225cd0 e93ef7edb3c2 463MB docker-snmp latest e93ef7edb3c2 463MB docker-lldp 202106.62230-1aa225cd0 ead128ea5c4e 461MB docker-lldp latest ead128ea5c4e 461MB docker-sonic-mgmt-framework 202106.62230-1aa225cd0 fe53fcff93d2 577MB docker-sonic-mgmt-framework latest fe53fcff93d2 577MB docker-database 202106.62230-1aa225cd0 556b260330f5 421MB docker-database latest 556b260330f5 421MB docker-orchagent 202106.62230-1aa225cd0 5a212f515759 451MB docker-orchagent latest 5a212f515759 451MB docker-sonic-telemetry 202106.62230-1aa225cd0 b83917de2448 510MB docker-sonic-telemetry latest b83917de2448 510MB docker-macsec 202106.62230-1aa225cd0 1e298b52b2c9 436MB docker-macsec latest 1e298b52b2c9 436MB docker-fpm-frr 202106.62230-1aa225cd0 2a160b2d657c 451MB docker-fpm-frr latest 2a160b2d657c 451MB docker-sflow 202106.62230-1aa225cd0 e67e9db41f9a 433MB docker-sflow latest e67e9db41f9a 433MB

admin@bkc-r2:~$ sudo config interface breakout Ethernet0 4x10G[25G] Do you want to Breakout the port, continue? [y/N]: y

Running Breakout Mode : 1x100G[50G,40G,25G,10G] Target Breakout Mode : 4x10G[25G]

Ports to be deleted : { "Ethernet0": "100000" } Ports to be added : { "Ethernet0": "10000", "Ethernet1": "10000", "Ethernet2": "10000", "Ethernet3": "10000" }

After running Logic to limit the impact

Final list of ports to be deleted : { "Ethernet0": "100000" } Final list of ports to be added :
{ "Ethernet0": "10000", "Ethernet1": "10000", "Ethernet2": "10000", "Ethernet3": "10000" } Note: Below table(s) have no YANG models: AUTO_TECHSUPPORT, AUTO_TECHSUPPORT_FEATURE, FEATURE, KDUMP, SNMP, SNMP_COMMUNITY, XCVRD_LOG, sonic_yang(3):All Keys are not parsed in FLEX_COUNTER_TABLE dict_keys(['ACL']) sonic_yang(3):exceptionList:[] sonic_yang(3):Data Loading Failed:All Keys are not parsed in FLEX_COUNTER_TABLE dict_keys(['ACL']) Data Loading Failed All Keys are not parsed in FLEX_COUNTER_TABLE dict_keys(['ACL']) ConfigMgmt Class creation failed Failed to break out Port. Error: Failed to load the config. Error: ConfigMgmtDPB Class creation failed admin@bkc-r2:~$

zhangyanzhao commented 2 years ago

@praveen-li will follow-up offline.

zhangyanzhao commented 2 years ago

Target to have an update next week

mbze430 commented 2 years ago

that would be great.  looking forward to it.  Will it be going into only the master or it will fall on the older branches? On Thursday, January 13, 2022, 12:11:02 PM CST, Yanzhao Zhang @.***> wrote:

Target to have an update next week

— Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android. You are receiving this because you were mentioned.Message ID: @.***>

aussieserverhosts commented 2 years ago

Confirmed also affecting Celestica DX010 on the latest build on the 202106 branch.

dgsudharsan commented 2 years ago

@praveen-li Can you provide an ETA for the fix?

praveen-li commented 2 years ago

We have PR https://github.com/Azure/sonic-utilities/pull/2066 already.

Thanks,

Regards Praveen

From: Sudharsan Dhamal Gopalarathnam @.> Sent: Tuesday, March 15, 2022 6:06 PM To: Azure/sonic-buildimage @.> Cc: Praveen Chaudhary @.>; Mention @.> Subject: Re: [Azure/sonic-buildimage] [DPB] Port Breakout issue on Mellanox SN2700 (Issue #9478)

@praveen-lihttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fpraveen-li&data=04%7C01%7Cpchaudhary%40linkedin.com%7C3f6fa40a56e141cecf4408da06e93aec%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637829896035585351%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=%2BIYh9Is8v%2BZfrkqFxEdnTSscAneY91gA6GCiv9U53KI%3D&reserved=0 Can you provide an ETA for the fix?

— Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2Fsonic-buildimage%2Fissues%2F9478%23issuecomment-1068622038&data=04%7C01%7Cpchaudhary%40linkedin.com%7C3f6fa40a56e141cecf4408da06e93aec%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637829896035585351%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=jca1KXeOn963Jx8FTQkpTZZTBQPWNOBxIWr2lOISthk%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAJHZHPI26MV2UYTXOCCSNHDVAEXZ3ANCNFSM5JVTVBLA&data=04%7C01%7Cpchaudhary%40linkedin.com%7C3f6fa40a56e141cecf4408da06e93aec%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637829896035585351%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=zOmmQThWQhP7%2FakROp8rQ5%2FmVrJrcQqc97kuQ%2FV9G6M%3D&reserved=0. Triage notifications on the go with GitHub Mobile for iOShttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapps.apple.com%2Fapp%2Fapple-store%2Fid1477376905%3Fct%3Dnotification-email%26mt%3D8%26pt%3D524675&data=04%7C01%7Cpchaudhary%40linkedin.com%7C3f6fa40a56e141cecf4408da06e93aec%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637829896035585351%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=EBI9n2sacmE3EluBPVSpo%2BxV25MMkRvLk8uHFPkFb3E%3D&reserved=0 or Androidhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplay.google.com%2Fstore%2Fapps%2Fdetails%3Fid%3Dcom.github.android%26referrer%3Dutm_campaign%253Dnotification-email%2526utm_medium%253Demail%2526utm_source%253Dgithub&data=04%7C01%7Cpchaudhary%40linkedin.com%7C3f6fa40a56e141cecf4408da06e93aec%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637829896035585351%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=tuFGXhhLzZXYoby%2FQTDv%2BxDaFEm9x3VmeTpmBZkpK5M%3D&reserved=0. You are receiving this because you were mentioned.Message ID: @.***>

zhangyanzhao commented 2 years ago

Need @praveen-li to fix the build failure of #2066

dgsudharsan commented 2 years ago

This issue regarding upper case MAC should be fixed with Praveen's changes getting merged in latest master branch.

zhangyanzhao commented 2 years ago

@praveen-li will double check if this issue is fixed already by #2066. Thanks.

zhangyanzhao commented 1 year ago

this is done and close per YANG subgroup discussion.