AliveDevil
commented
3 years ago To add to this:
- Windows Server 2022 (20303) and Server 2022 (20324)
- Windows Server 2019 (with latest cumulative patch)
Do not get past Stage 5 Adding Interfaces to network controller. Windows Server locale (de_DE, en_US) doesn't make any difference here. This is the stack trace (this time in english):
curl.exe https://sdn.home.arpa/networking/V1/operations/b5a85276-16ff-4ed5-a84e-af664a907c22
{
"status": "Failed",
"error": {
"code": "InternalServerError",
"message": "An error occured.",
"innerError": "System.ArgumentOutOfRangeException: Index was out of range. Must be non-negative and less than the size of the collection.\\r\\nParameter name: startIndex\\r\\n at System.ParseNumbers.StringToInt(String s, Int32 radix, Int32 flags, Int32* currPos)\\r\\n at System.Convert.ToUInt32(String value, Int32 fromBase)\\r\\n at Microsoft.Windows.Networking.NetworkController.RestApi.Common.NetworkInterfaceConverter.ConvertToWcf(NetworkInterfaceIpConfiguration ipConfig, List`1 vnetList)\\r\\n at System.Linq.Enumerable.WhereSelectEnumerableIterator`2.MoveNext()\\r\\n at System.Linq.Buffer`1..ctor(IEnumerable`1 source)\\r\\n at System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)\\r\\n at Microsoft.Windows.Networking.NetworkController.RestApi.Common.NetworkInterfaceConverter.ConvertToWcf(NetworkInterface networkInterface, List`1 vnetList)\\r\\n at Microsoft.Windows.Networking.NetworkController.RestApi.Tenant.Operations.PutNetworkInterfaceOperation.UpdateVsm(NetworkInterface networkInterface)\\r\\n at Microsoft.Windows.Networking.NetworkController.RestApi.Tenant.Operations.PutNetworkInterfaceOperation.RunBackgroundTaskInternal()\\r\\n at Microsoft.WindowsAzure.Networking.Nrp.Common.Utilities.Retry.<>c__DisplayClass4_0.<ExecuteWithRetriesTimeoutAsync>b__0()\\r\\n at Microsoft.WindowsAzure.Networking.Nrp.Common.Utilities.Retry.<ExecuteWithRetriesTimeoutAsync>d__5`1.MoveNext()\\r\\n--- End of stack trace from previous location where exception was thrown ---\\r\\n at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()\\r\\n at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\\r\\n at Microsoft.WindowsAzure.Networking.Nrp.Common.Utilities.Retry.<ExecuteWithRetriesTimeoutAsync>d__4.MoveNext()\\r\\n--- End of stack trace from previous location where exception was thrown ---\\r\\n at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()\\r\\n at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\\r\\n at Microsoft.Windows.Networking.NetworkController.RestApi.Common.Operations.PutResourceOperation`1.<<RunBackgroundTaskAsync>b__6_0>d.MoveNext()\\r\\n--- End of stack trace from previous location where exception was thrown ---\\r\\n at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()\\r\\n at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\\r\\n at Microsoft.Windows.Networking.NetworkController.RestApi.Common.Operations.PutResourceOperation`1.<RunBackgroundTaskAsync>d__6.MoveNext()"
}
}As well as the event viewer entry for the request:
Request: PUT https://sdn.home.arpa/networking/V4/networkInterfaces/sdnGW01.ad.home.arpa_FrontEnd
Host: sdn.home.arpa
User-Agent: Mozilla/5.0,(Windows NT; Windows NT 10.0; en-US),WindowsPowerShell/5.1.20324.3
Content-Length: 593
Content-Type: application/json; charset=utf-8
{"ResourceId":"sdnGW01.ad.home.arpa_FrontEnd","ResourceId:Key":"sdnGW01.ad.home.arpa_FrontEnd","Properties":{"PrivateMacAddress":"001DD8220008","PrivateMacAllocationMethod":"Static","IsHostVirtualNetworkInterface":false,"IsPrimary":false,"IsMultitenantStack":false,"IpConfigurations":[{"InstanceId":"00000000-0000-0000-0000-000000000000","ResourceId":"FrontEnd","Properties":{"IsPrimary":false,"PrivateIPAddress":"10.17.237.6","PrivateIPAllocationMethod":"Static","Subnet":{"ResourceRef":"/logicalnetworks/HNVPA/subnets/10.17.237.0_24","InstanceId":"00000000-0000-0000-0000-000000000000"}}}]}}
Response: x-ms-request-id: b5a85276-16ff-4ed5-a84e-af664a907c22
Azure-AsyncOperation: https://sdn.home.arpa/networking/V1/operations/b5a85276-16ff-4ed5-a84e-af664a907c22
Retry-After: 10
Content-Type: application/json; charset=utf-8
{
"resourceRef": "/networkInterfaces/sdnGW01.ad.home.arpa_FrontEnd",
"resourceId": "sdnGW01.ad.home.arpa_FrontEnd",
"etag": "W/\"d7676b38-b147-4947-ac99-beafde82b5cc\"",
"instanceId": "1c4792c4-1c05-4d81-a16d-6918226ff5e6",
"properties": {
"provisioningState": "Updating",
"ipConfigurations": [
{
"resourceRef": "/networkInterfaces/sdnGW01.ad.home.arpa_FrontEnd/ipConfigurations/FrontEnd",
"resourceId": "FrontEnd",
"etag": "W/\"d7676b38-b147-4947-ac99-beafde82b5cc\"",
"instanceId": "6ff8c8b0-e442-40a4-9d10-abf2339cea98",
"properties": {
"provisioningState": "Updating",
"privateIPAddress": "10.17.237.6",
"privateIPAllocationMethod": "Static",
"subnet": {
"resourceRef": "/logicalnetworks/HNVPA/subnets/10.17.237.0_24"
},
"loadBalancerBackendAddressPools": [],
"loadBalancerInboundNatRules": [],
"isPrimary": false
}
}
],
"dnsSettings": {},
"privateMacAddress": "001DD8220008",
"privateMacAllocationMethod": "Static",
"serviceInsertionElements": [],
"portSettings": {
"provisioningState": "Succeeded",
"macSpoofingEnabled": "Disabled",
"arpGuardEnabled": "Disabled",
"dhcpGuardEnabled": "Disabled",
"stormLimit": 0,
"portFlowLimit": 0,
"iovWeight": 0,
"iovInterruptModeration": "Off",
"iovQueuePairsRequested": 0,
"vmqWeight": 100,
"qosSettings": {
"provisioningState": "Succeeded",
"outboundReservedValue": 0,
"outboundMaximumMbps": 0,
"inboundMaximumMbps": 0,
"enableHardwareLimits": false
}
},
"isHostVirtualNetworkInterface": false,
"isPrimary": false,
"isMultitenantStack": false,
"counters": []
}
}
HttpStatusCode: CreatedA CURL returns:
curl.exe https://sdn.home.arpa/networking/V4/networkInterfaces/sdnGW01.ad.home.arpa_FrontEnd/ipConfigurations/FrontEnd
{
"resourceRef": "/networkInterfaces/sdnGW01.ad.home.arpa_FrontEnd/ipConfigurations/FrontEnd",
"resourceId": "FrontEnd",
"etag": "W/\"c5aba806-97fb-479f-b3c4-375058b0b8a8\"",
"instanceId": "6ff8c8b0-e442-40a4-9d10-abf2339cea98",
"properties": {
"provisioningState": "Failed",
"privateIPAddress": "10.17.237.6",
"privateIPAllocationMethod": "Static",
"subnet": {
"resourceRef": "/logicalnetworks/HNVPA/subnets/10.17.237.0_24"
},
"loadBalancerBackendAddressPools": [],
"loadBalancerInboundNatRules": [],
"isPrimary": false
}
}The HNVPA subnet 10.17.237.0/24 is successfully created:
curl.exe https://sdn.home.arpa/networking/V4/logicalnetworks/HNVPA/subnets/10.17.237.0_24
{
"resourceRef": "/logicalnetworks/HNVPA/subnets/10.17.237.0_24",
"resourceId": "10.17.237.0_24",
"etag": "W/\"d90152e6-0309-47a8-af74-2bd01d4dabd1\"",
"instanceId": "8789cf67-7000-4eb5-8edf-040a6d0ada24",
"properties": {
"provisioningState": "Succeeded",
"addressPrefix": "10.17.237.0/24",
"ipConfigurations": [
{
"resourceRef": "/networkInterfaces/sdnGW01.ad.home.arpa_FrontEnd/ipConfigurations/FrontEnd"
}
],
"networkInterfaces": [
{
"resourceRef": "/servers/bcc4364a-bacb-4671-97c0-55390695fae3/networkInterfaces/Default Switch"
},
{
"resourceRef": "/servers/1735ed87-4820-4915-af4f-dde857ff0773/networkInterfaces/Default Switch"
}
],
"gatewayPools": [],
"networkConnections": [],
"vlanID": "",
"ipPools": [
{
"resourceRef": "/logicalnetworks/HNVPA/subnets/10.17.237.0_24/ipPools/10.17.237.0_24",
"resourceId": "10.17.237.0_24",
"etag": "W/\"d90152e6-0309-47a8-af74-2bd01d4dabd1\"",
"instanceId": "c23dfe31-0834-4fab-89be-f377ba8e7e9d",
"properties": {
"provisioningState": "Succeeded",
"startIpAddress": "10.17.237.6",
"endIpAddress": "10.17.237.199"
}
}
],
"dnsServers": [],
"defaultGateways": [
"10.17.237.1"
],
"isPublic": false,
"usage": {
"numberOfIPAddresses": 194,
"numberofIPAddressesAllocated": 0,
"numberOfIPAddressesInTransition": 0
}
}
}
luyaof
SDN Monitoring works, but just isn't in the menu (WAC 2009 aswell as 2103).
Did someone figure out how to get SDNExpress deploying without failures?
With a bunch of changes already done (as in https://github.com/alivedevil/sdn) to ensure that at least the virtual machine deployment works out, I am buffled that even the default MultiNodeSampleConfig-file fails to configure Stage 5 correctly.
Following SDNExpress log is produced:
This is in German, though it fails with an ODataEndpointProxyInvokeFailure for Adding Network Interfaces to network controller somewhere in https://github.com/microsoft/SDN/blob/master/SDNExpress/scripts/SDNExpressModule.psm1#L2151-L2173 As there is no other logging output generated here I can only speculate where it fails exactly.
This is the stack trace referenced in the operations-log:
Its in German, translated would be
Source index must not be negative or smaller than collection length.I gathered the diagnostics information and the only thing failing here is
So something with the ipConfigurations for sdnGW01_FrontEnd is wrong, but I can't for whatever reason determine what's wrong here. I deployed using the default MultiNodeSampleConfig with 3 NCs, 3 Mux and 3 GWs - won't work. I tried 1 NC, 0 Mux, 2 Gw - won't work. 1 NC, 1 Mux, 2 GW (as minimally configured with SDNExpressGUI).
Checking on the Hyper-V Host I see
PAhostVNic1andPAhostVNic2being created, but they fail to get an IP. Following configuration has been used to deploy SDN:Yes, I'm using Server 2022, though it really doesn't make anything different if I'm using 2019 or even 2016 - it just doesn't get past Stage 5. Everything is to be configured without VLAN-ids. For testing purposes the Hyper-V-machine is virtualized, and the SDN infrastructure is virtualized in-parallel to the Hyper-V machine (Hosts belsa and eurodona host all SDN infrastructure and my testing Hyper-V machine). With the MultiNodeSampleConfig changed with VHD path, domain and user and only the management IPs changed it won't deploy either. So … I'm really at a loss here.
Not deploying the SDN Gateway is unfortunately no solution as then there is no way of adding the SDN endpoint to Windows Admin Center as it complains about invalid URIs.