search

HewlettPackard / POSH-HPEOneView

PowerShell language bindings library for HPE OneView.
http://hewlettpackard.github.io/POSH-HPEOneView/
125 stars 52 forks source link

Bandwidth per Flexible LOM in Oneview Server Profile #98

Closed 5truja closed 8 years ago

5truja commented 8 years ago

Please fill in as much information as possible to help resolve your issue.

Expected Behavior

I have two Uplinks (each 10Gbps). I created two Network Set on one of the uplinks (A and B side) On the other Uplink I created tunnel.

Actual Behavior

When creating server profile template I can create only max 10Gbps distributed over 4 (or 8 A an B side) Flexible LOMs. In VC/VCEM i could present (end to end let's say in hypervisor) 10Gbps per NIC team but not in OV since it does not allow med to go over 10Gbps in total. What is the catch here?

Steps to reproduce

Version Information

HPE OneView PowerShell Library Version (Get-HPOVVersion): HPE OneView Appliance Version:
Output from $PSVersionTable on your Windows Host:

ChrisLynchHPE commented 8 years ago

This is not a bug with the HPE OneView POSH Library, nor is a bug with the HPE OneVeiw appliance. We currently do not support over provisioning like we do with Virtual Connect Manager (VCM). Over-provisioning inVCM will not allow an interface to be set at the value you set anyhow. All of the interfaces will get a proportional value of the bandwidth based on their requested value to the aggregate of the defined FlexNICs.

5truja commented 8 years ago

I would not call that “overprovisioned” (it’s hypothetical question of course), since one Network set Is connected to 2x10Gbps (X2) ethernet uplink and share that very same uplink with another Network set. The third (TUNNEL) is connected to anoTher 2x10Gbps (A-B and X3 Ethernet uplink). Så basically oneview is limiting ESXi to use available bandwidth which would be fine to use since we separate hypervisor (X2 ) and VM guest (X3) stacks. So you mean there is no other way that configure as 10GBbps in total per serverprofile, which is strange since Net Set is having 20Gbps as max bandwidth value (?).

From: Chris Lynch [mailto:notifications@github.com] Sent: den 19 april 2016 17:15 To: HewlettPackard/POSH-HPOneView POSH-HPOneView@noreply.github.com Cc: Brekalo Mladen Mladen.Brekalo@tieto.com Subject: Re: [HewlettPackard/POSH-HPOneView] Bandwidth per Flexible LOM in Oneview Server Profile (#98)

This is not a bug with the HPE OneView POSH Library, nor is a bug with the HPE OneVeiw appliance. We currently do not support over provisioning like we do with Virtual Connect Manager (VCM). Over-provisioning inVCM will not allow an interface to be set at the value you set anyhow. All of the interfaces will get a proportional value of the bandwidth based on their requested value to the aggregate of the defined FlexNICs.

— You are receiving this because you authored the thread. Reply to this email directly or view it on GitHubhttps://github.com/HewlettPackard/POSH-HPOneView/issues/98#issuecomment-211973572

ChrisLynchHPE commented 8 years ago

I think you have a misunderstanding of how Bandwidth is assigned and how it affects (or doesn't affect) other resources.

An Uplink Set defines how the Uplink Ports should be connected at, to the upstream fabric infrastructure. It does not adjust, or directly impact the value of the Requested Bandwidth you can set at the other resources; Networks, Network Sets and Server Profile Connections

A Network represents a L2 fabric, which is then assigned to a Server Profile Connection. The Preferred and Maximum bandwidth values define what are the Min and Max Bandwidth values that a Server Profile Connection can request. So, if I set the Preferred to say 3Gbps, and the Maximum to 5Gbps, assign it to a Server Profile Connection without specifying any bandwidth, the Connection will request the 3Gbps value. If I set the value to 5.5Gbps instead, the request will fail because the value is greater than 5Gbps. Either value has no impact on the Uplink Set assigned Uplink Port(s).

A Network Set is a collection of Ethernet Networks to define an 802.1Q Trunk port on the Downlink Ports, which then map by assignment to the Server Profile Connection. The same behavior with Networks applies here. What could be confusing is that the assigned Ethernet Networks Bandwidth allocation within the Network Set is actually overriden by the Network Set bandwidth values.

A Server Profile Connection has a similar Preferred Bandwidth value, but it is called Requested. Bandwidth in the Server Profile Connection isn't assigned or allocated until the Create Server Profile task is validated.

So let's take the following as an example:

I then attempt to go assign all of the Network resources as follows, using default bandwidth values:

The Server Profile Create request will fail. Why? Because the aggregate Bandwidth request is 12Gbp per Physical 10Gb port. We call this oversubscription. To fix this, I would need to adjust the Virtual Machine Set Requested Bandwidth value to less than 8Gbp.

In Virtual Connect Manager, we would give a proportional value to each requested Connection, resulting in the following new Allocated assignment using (Requested Bandwidth / Aggregate Bandwidth * Total Port Speed Capacity) formula:

We also introduced a feature in VCM called Mix/Max Bandwidth. This allows you to set the maximum Bandwidth value possible for the Connection. We implemented a time sharing mechanism to allow other Connections to burst or consume all of the bandwidth allocated. Think of this as a similar concept to VMware Shares. If the Share is equal, then all have equal share to the source, but one could consume all of the available Shares. This is another way to oversubscribe.

HPE OneView does not currently support Oversubscription. You must define the Requested Bandwidth to not exceed the maximum aggregate of the FlexNICs from the same physical port (e.g. FlexLOM1:A, FlexLOM1:B, FlexLOM1:C, and FlexLOM1:D aggregate cannot exceed 10Gbp for a FlexFabric or Flex-10 Adapter).

5truja commented 8 years ago

Great elaboration and thank you for that.

HPE OneView does not currently support Oversubscription. You must define the Requested Bandwidth to not exceed the maximum aggregate of the FlexNICs from the same physical port (e.g. FlexLOM1:A, FlexLOM1:B, FlexLOM1:C, and >FlexLOM1:D aggregate cannot exceed 10Gbp for a FlexFabric or Flex-10 Adapter).

This is a bit disappointing since today in VCEM environment I can connect my mgmt networks to separate uplink (X2) and use all 10Gbps in server profile and also VMs to another (X3) and use 10Gbps.

We are using multiple VMotion IP addresses too (since vSphere 5 ) having which makes migrations and maintenance mode operations much faster. I need test this in OV environment and compare. I hope it will do.

So, if I set the Preferred to say 3Gbps, and the Maximum to 5Gbps, assign it to a Server Profile Connection without specifying any bandwidth,

Please correct me if I am wrong but it sounds like that I could create Server Profile without specifying bandwidth (AND not using Network Set but only Multiple Networks like in VCEM case) and get another behavior regarding total bandwidth?

However I do not see that creating server profile (in GUI at least) is possible without bandwidth parameter.

From: Chris Lynch [mailto:notifications@github.com] Sent: den 19 april 2016 19:44 To: HewlettPackard/POSH-HPOneView POSH-HPOneView@noreply.github.com Cc: Brekalo Mladen Mladen.Brekalo@tieto.com Subject: Re: [HewlettPackard/POSH-HPOneView] Bandwidth per Flexible LOM in Oneview Server Profile (#98)

I think you have a misunderstanding of how Bandwidth is assigned and how it affects (or doesn't affect) other resources.

An Uplink Set defines how the Uplink Ports should be connected at, to the upstream fabric infrastructure. It does not adjust, or directly impact the value of the Requested Bandwidth you can set at the other resources; Networks, Network Sets and Server Profile Connections

A Network represents a L2 fabric, which is then assigned to a Server Profile Connection. The Preferred and Maximum bandwidth values define what are the Min and Max Bandwidth values that a Server Profile Connection can request. So, if I set the Preferred to say 3Gbps, and the Maximum to 5Gbps, assign it to a Server Profile Connection without specifying any bandwidth, the Connection will request the 3Gbps value. If I set the value to 5.5Gbps instead, the request will fail because the value is greater than 5Gbps. Either value has no impact on the Uplink Set assigned Uplink Port(s).

A Network Set is a collection of Ethernet Networks to define an 802.1Q Trunk port on the Downlink Ports, which then map by assignment to the Server Profile Connection. The same behavior with Networks applies here. What could be confusing is that the assigned Ethernet Networks Bandwidth allocation within the Network Set is actually overriden by the Network Set bandwidth values.

A Server Profile Connection has a similar Preferred Bandwidth value, but it is called Requested. Bandwidth in the Server Profile Connection isn't assigned or allocated until the Create Server Profile task is validated.

So let's take the following as an example:

I then attempt to go assign all of the Network resources as follows, using default bandwidth values:

The Server Profile Create request will fail. Why? Because the aggregate Bandwidth request is 12Gbp per Physical 10Gb port. We call this oversubscription. To fix this, I would need to adjust the Virtual Machine Set Requested Bandwidth value to less than 8Gbp.

In Virtual Connect Manager, we would give a proportional value to each requested Connection, resulting in the following new Allocated assignment using (Requested Bandwidth / Aggregate Bandwidth * Total Port Speed Capacity) formula:

We also introduced a feature in VCM called Mix/Max Bandwidth. This allows you to set the maximum Bandwidth value possible for the Connection. We implemented a time sharing mechanism to allow other Connections to burst or consume all of the bandwidth allocated. Think of this as a similar concept to VMware Shares. If the Share is equal, then all have equal share to the source, but one could consume all of the available Shares. This is another way to oversubscribe.

HPE OneView does not currently support Oversubscription. You must define the Requested Bandwidth to not exceed the maximum aggregate of the FlexNICs from the same physical port (e.g. FlexLOM1:A, FlexLOM1:B, FlexLOM1:C, and FlexLOM1:D aggregate cannot exceed 10Gbp for a FlexFabric or Flex-10 Adapter).

— You are receiving this because you authored the thread. Reply to this email directly or view it on GitHubhttps://github.com/HewlettPackard/POSH-HPOneView/issues/98#issuecomment-212037357

ChrisLynchHPE commented 8 years ago

This is a bit disappointing since today in VCEM environment I can connect my mgmt networks to separate uplink (X2) and use all 10Gbps in server profile and also VMs to another (X3) and use 10Gbps.

Except you are not using 2 x 10Gbps. Your adapter has two physical ports (if we take the 554flb adapter as an example), each with a max connection of 10Gbps. VCM/VCEM allows for oversubscription, so that if a FlexNIC has no activity (or very little), other FlexNICs can use more bandwidth. This is similar to the VMware Shares capability I mentioned above. However, none of the FlexNICs can go beyond 10Gbps. And the aggregate bandwidth with all FlexNICs (A, B, C, and D) from the same physical port (FLB1) cannot exceed 10Gbps anyhow.

We are using multiple VMotion IP addresses too (since vSphere 5 ) having which makes migrations and maintenance mode operations much faster. I need test this in OV environment and compare. I hope it will do.

Yes, you can configure multiple Interfaces to different VMotion networks within OneView. You have the same Network allocation restrictions in OneView as you do with VCM/VCEM.

Please correct me if I am wrong but it sounds like that I could create Server Profile without specifying bandwidth (AND not using Network Set but only Multiple Networks like in VCEM case) and get another behavior regarding total bandwidth?

No. The Multiple Networks option is replaced by Network Sets within HPE OneView. You would get the exact same bandwidth allocation behavior with Network Sets as you do with Multiple Networks in VCM/VCEM.

However I do not see that creating server profile (in GUI at least) is possible without bandwidth parameter.

You still need to provide a Requested Bandwidth value in the Server Profile. Ethernet Connections always default to 2.5Gbps.

5truja commented 8 years ago

Hi Chris,

Thanks again for clarifying all differences between VCEM and OV.

Kind regards and have a nice weekend

Med v?nlig h?lsning, Mladen Brekalo

22 apr. 2016 kl. 21:03 skrev Chris Lynch notifications@github.com<mailto:notifications@github.com>:

This is a bit disappointing since today in VCEM environment I can connect my mgmt networks to separate uplink (X2) and use all 10Gbps in server profile and also VMs to another (X3) and use 10Gbps.

Except you are not using 2 x 10Gbps. Your adapter has two physical ports (if we take the 554flb adapter as an example), each with a max connection of 10Gbps. VCM/VCEM allows for oversubscription, so that if a FlexNIC has no activity (or very little), other FlexNICs can use more bandwidth. This is similar to the VMware Shares capability I mentioned above. However, none of the FlexNICs can go beyond 10Gbps. And the aggregate bandwidth with all FlexNICs (A, B, C, and D) from the same physical port (FLB1) cannot exceed 10Gbps anyhow.

We are using multiple VMotion IP addresses too (since vSphere 5 ) having which makes migrations and maintenance mode operations much faster. I need test this in OV environment and compare. I hope it will do.

Yes, you can configure multiple Interfaces to different VMotion networks within OneView. You have the same Network allocation restrictions in OneView as you do with VCM/VCEM.

Please correct me if I am wrong but it sounds like that I could create Server Profile without specifying bandwidth (AND not using Network Set but only Multiple Networks like in VCEM case) and get another behavior regarding total bandwidth?

No. The Multiple Networks option is replaced by Network Sets within HPE OneView. You would get the exact same bandwidth allocation behavior with Network Sets as you do with Multiple Networks in VCM/VCEM.

However I do not see that creating server profile (in GUI at least) is possible without bandwidth parameter.

You still need to provide a Requested Bandwidth value in the Server Profile. Ethernet Connections always default to 2.5Gbps.

You are receiving this because you authored the thread. Reply to this email directly or view it on GitHubhttps://github.com/HewlettPackard/POSH-HPOneView/issues/98#issuecomment-213555485

ChrisLynchHPE commented 8 years ago

No problem. Closing.