microsoft / service-fabric

Service Fabric is a distributed systems platform for packaging, deploying, and managing stateless and stateful distributed applications and containers at large scale.
https://docs.microsoft.com/en-us/azure/service-fabric/
MIT License
3.03k stars 400 forks source link

FABRIC_E_IMAGEBUILDER_UNEXPECTED_ERROR: The remote server returned an error: (404) #335

Open jrmcdona opened 5 years ago

jrmcdona commented 5 years ago

I have using a ps1 script to deployment my SF setup. But I am getting this error and not really sure what it means. Any idea here?

PowerShell : New-AzureRmResourceGroupDeployment : 12:05:40 PM - Resource Microsoft.ServiceFabric/clusters/applicationTypes/versions 
At C:\Users\Owner\Source\Repos\Xbox.Ambassadors\RnR.AzureDeploymentTemplate\RnR.AzureDeploymentTemplate\RnR.AzureDeploymentTemplate\Deployments\DeployMixerPreview.ps1:1 char:1
+ PowerShell -File ..\Deploy-AzureResourceGroup.ps1 `
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (New-AzureRmReso...Types/versions :String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError

'mixer-pre/PatchOrchestrationApplicationType/1.2.2' failed with message '{
  "status": "Failed",
  "error": {
    "code": "ResourceDeploymentFailure",
    "message": "The resource operation completed with terminal provisioning state 'Failed'.",
    "details": [
      {
        "code": "ClusterChildResourceOperationFailed",
        "message": "Resource operation failed. Operation: CreateOrUpdate. Error details: {\r\n  \"Details\": 
\"FABRIC_E_IMAGEBUILDER_UNEXPECTED_ERROR: The remote server returned an error: (404) Not Found.\"\r\n}",
        "details": []
      }
    ]
  }
}'
At C:\Users\Owner\Source\Repos\Xbox.Ambassadors\RnR.AzureDeploymentTemplate\RnR.AzureDeploymentTemplate\RnR.AzureDeploy
mentTemplate\Deploy-AzureResourceGroup.ps1:322 char:5
+     New-AzureRmResourceGroupDeployment -Name ((Get-ChildItem $Templat ...
+     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (:) [New-AzureRmResourceGroupDeployment], Exception
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.ResourceManager.Cmdlets.Implementation.NewAzureResourceGroupDep 
   loymentCmdlet

New-AzureRmResourceGroupDeployment : 12:05:40 PM - Resource operation failed. Operation: CreateOrUpdate. Error 
details: {
  "Details": "FABRIC_E_IMAGEBUILDER_UNEXPECTED_ERROR: The remote server returned an error: (404) Not Found."
}
At C:\Users\Owner\Source\Repos\Xbox.Ambassadors\RnR.AzureDeploymentTemplate\RnR.AzureDeploymentTemplate\RnR.AzureDeploy
mentTemplate\Deploy-AzureResourceGroup.ps1:322 char:5
+     New-AzureRmResourceGroupDeployment -Name ((Get-ChildItem $Templat ...
jrmcdona commented 5 years ago

here are details from my deployment template in regards to PatchOrchestrationApplication.

 {
      "apiVersion": "2017-07-01-preview",
      "type": "Microsoft.ServiceFabric/clusters/applications",
      "name": "[concat(parameters('clusterName'), '/', variables('patchOrchestrationName'))]",
      "location": "[resourceGroup().location]",
      "tags": {
        "resourceType": "Application",
        "clusterName": "[parameters('clusterName')]",
        "displayName": "PatchOrchestrationApplication"
      },
      "dependsOn": [
        "[concat('Microsoft.ServiceFabric/clusters/', parameters('clusterName'), '/applicationTypes/', variables('patchOrchestrationTypeName'), '/versions/', variables('patchOrchestrationTypeVersion'))]"
      ],
      "properties": {
        "typeName": "[variables('patchOrchestrationTypeName')]",
        "typeVersion": "[variables('patchOrchestrationTypeVersion')]",
        "upgradePolicy": {
          "forceRestart": false,
          "rollingUpgradeMonitoringPolicy": {
            "healthCheckWaitDuration": "00:02:00.0",
            "healthCheckStableDuration": "00:05:00.0",
            "healthCheckRetryTimeout": "00:10:00.0",
            "upgradeTimeout": "01:00:00.0",
            "upgradeDomainTimeout": "00:20:00.0"
          },
          "applicationHealthPolicy": {
            "considerWarningAsError": "false",
            "maxPercentUnhealthyDeployedApplications": "50",
            "defaultServiceTypeHealthPolicy": {
              "maxPercentUnhealthyServices": "50",
              "maxPercentUnhealthyPartitionsPerService": "50",
              "maxPercentUnhealthyReplicasPerPartition": "50"
            }
          }
        }
      }

The cluster exists.

image

iyyappam commented 5 years ago

Just checking with you to see if the issue still exists. To mitigate, retrying the deployment should take care of it. In order for us to root cause, could you provide the resource id of the cluster (You can get it from the properties link on the left side) and date of this issue (timestamp is in the pasted log).

michaelatvaronis commented 2 years ago

im running into the same issue. was this ever resolved?

{"status":"Failed","error":{"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.","details":[{"code":"Conflict","message":"{\r\n  \"status\": \"Failed\",\r\n  \"error\": {\r\n    \"code\": \"ResourceDeploymentFailure\",\r\n    \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n    \"details\": [\r\n      {\r\n        \"code\": \"ClusterChildResourceOperationFailed\",\r\n        \"message\": \"Resource operation failed. Operation: CreateOrUpdate. Error details: {\\r\\n  \\\"Details\\\": \\\"FABRIC_E_IMAGEBUILDER_VALIDATION_ERROR: DOWNLOAD PATH SANITIZED\\\"\\r\\n}\",\r\n        \"details\": []\r\n      }\r\n    ]\r\n  }\r\n}"}]}}