Closed BiologyGeek closed 1 day ago
Danny-Cooke-CK
commented
4 months ago Hi. I would always default to these instructions for any bundle. https://microsoft.github.io/AzureTRE/latest/tre-admins/registering-templates/ What version of AzureTRE are you using ?
BiologyGeek
commented
4 months ago Hi. I would always default to these instructions for any bundle. https://microsoft.github.io/AzureTRE/latest/tre-admins/registering-templates/ What version of AzureTRE are you using ?
Thank you @Danny-Cooke-CK!
After trying to run $ make bundle-build DIR=templates/shared_services/cyclecloud, this error occurred:
@MyCodespaceUsername ➜ /workspaces/AzureTRE-Deployment (main) $ make bundle-build DIR=templates/shared_services/cyclecloud
»»» 🧩 Building templates/shared_services/cyclecloud bundle with Porter...
╔══════════════════════════════════════╗
║ Azure TRE Makefile ║
╚══════════════════════════════════════╝
»»» ✅ Checking pre-reqs...
Checking for Azure CLI...
Loading local environment variables...
Checking for Docker...
Checking for porter...
»»» 🔨 Azure details from logged on user
»»» • Subscription: My Azure Subscription
»»» • Tenant: My Tenant ID
docker ps failed, setting docker.sock permissions
/bin/bash: line 4: cd: templates/shared_services/cyclecloud: No such file or directory
make: *** [/home/vscode/AzureTRE/Makefile:189: bundle-build] Error 1Also after trying to run $ make workspace_service_bundle BUNDLE=cyclecloud, this error occurred:
@MyCodespaceUsername ➜ /workspaces/AzureTRE-Deployment (main) $ make workspace_service_bundle BUNDLE=cyclecloud
make bundle-build bundle-publish bundle-register \
DIR="/home/vscode/AzureTRE//templates/workspace_services/cyclecloud" BUNDLE_TYPE=workspace_service
make[1]: Entering directory '/workspaces/AzureTRE-Deployment'
»»» 🧩 Building /home/vscode/AzureTRE//templates/workspace_services/cyclecloud bundle with Porter...
╔══════════════════════════════════════╗
║ Azure TRE Makefile ║
╚══════════════════════════════════════╝
»»» ✅ Checking pre-reqs...
Checking for Azure CLI...
Loading local environment variables...
Checking for Docker...
Checking for porter...
»»» 🔨 Azure details from logged on user
»»» • Subscription: My Azure Subscription
»»» • Tenant: My Tenant ID
/bin/bash: line 4: cd: /home/vscode/AzureTRE//templates/workspace_services/cyclecloud: No such file or directory
make[1]: *** [/home/vscode/AzureTRE/Makefile:189: bundle-build] Error 1
make[1]: Leaving directory '/workspaces/AzureTRE-Deployment'
make: *** [/home/vscode/AzureTRE/Makefile:283: workspace_service_bundle] Error 2The same issue occurred with $ make bundle-build DIR=templates/workspace_services/azureml.
@MyCodespaceUsername ➜ /workspaces/AzureTRE-Deployment (main) $ make bundle-build DIR=templates/workspace_services/azureml
»»» 🧩 Building templates/workspace_services/azureml bundle with Porter...
╔══════════════════════════════════════╗
║ Azure TRE Makefile ║
╚══════════════════════════════════════╝
»»» ✅ Checking pre-reqs...
Checking for Azure CLI...
Loading local environment variables...
Checking for Docker...
Checking for porter...
»»» 🔨 Azure details from logged on user
»»» • Subscription: My Azure Subscription
»»» • Tenant: My Tenant ID
docker ps failed, setting docker.sock permissions
/bin/bash: line 4: cd: templates/workspace_services/azureml: No such file or directory
make: *** [/home/vscode/AzureTRE/Makefile:189: bundle-build] Error 1But $ make workspace_service_bundle BUNDLE=azureml worked.
Update: No success with these commands:
$ make workspace_bundle DIR=templates/shared_services/cyclecloud
$ make shared_service_bundle DIR=templates/shared_services/cyclecloud
$ make user_resource_bundle DIR=templates/shared_services/cyclecloud
@MyCodespaceUsername ➜ /workspaces/AzureTRE-Deployment (main) $ make workspace_bundle DIR=templates/shared_services/cyclecloud
make bundle-build bundle-publish bundle-register \
DIR="/home/vscode/AzureTRE//templates/workspaces/" BUNDLE_TYPE=workspace
make[1]: Entering directory '/workspaces/AzureTRE-Deployment'
»»» 🧩 Building /home/vscode/AzureTRE//templates/workspaces/ bundle with Porter...
╔══════════════════════════════════════╗
║ Azure TRE Makefile ║
╚══════════════════════════════════════╝
»»» ✅ Checking pre-reqs...
Checking for Azure CLI...
Loading local environment variables...
Checking for Docker...
Checking for porter...
»»» 🔨 Azure details from logged on user
»»» • Subscription: My Azure Subscription
»»» • Tenant: My Tenant ID
Error: open porter.yaml: no such file or directory
Error: open porter.yaml: no such file or directory
make[1]: *** [/home/vscode/AzureTRE/Makefile:189: bundle-build] Error 1
make[1]: Leaving directory '/workspaces/AzureTRE-Deployment'
make: *** [/home/vscode/AzureTRE/Makefile:279: workspace_bundle] Error 2and no success with these commands:
$ make workspace_bundle cyclecloud
$ make shared_service_bundle cyclecloud
$ make user_resource_bundle cyclecloud
@MyCodespaceUsername ➜ /workspaces/AzureTRE-Deployment (main) $ make workspace_bundle cyclecloud
make bundle-build bundle-publish bundle-register \
DIR="/home/vscode/AzureTRE//templates/workspaces/" BUNDLE_TYPE=workspace
make[1]: Entering directory '/workspaces/AzureTRE-Deployment'
»»» 🧩 Building /home/vscode/AzureTRE//templates/workspaces/ bundle with Porter...
╔══════════════════════════════════════╗
║ Azure TRE Makefile ║
╚══════════════════════════════════════╝
»»» ✅ Checking pre-reqs...
Checking for Azure CLI...
Loading local environment variables...
Checking for Docker...
Checking for porter...
»»» 🔨 Azure details from logged on user
»»» • Subscription: My Azure Subscription
»»» • Tenant: My Tenant ID
Error: open porter.yaml: no such file or directory
Error: open porter.yaml: no such file or directory
make[1]: *** [/home/vscode/AzureTRE/Makefile:189: bundle-build] Error 1
make[1]: Leaving directory '/workspaces/AzureTRE-Deployment'
make: *** [/home/vscode/AzureTRE/Makefile:279: workspace_bundle] Error 2Surprisingly, after re-running this command, it seems to have worked: $ make shared_service_bundle BUNDLE=cyclecloud. The terminal output was something like this:
Initializing modules ...
Downloading git :: https://github.com/microsoft/terraform-azurerm-environment-configuration.git?ref=0.2.0 for terraform_azurerm_environment_configuration ...
- terraform_azurerm_environment_configuration in .terraform/modules/terraform_azurerm_environment_configuration
Initializing provider plugins ...
Reusing previous version of hashicorp/random from the dependency lock file
Reusing previous version of hashicorp/azurerm from the dependency lock file
Installing hashicorp/random v3.4.2 ..
Installed hashicorp/random v3.4.2 (signed by HashiCorp)
Installing hashicorp/azurerm v3.5.0 ...
Installed hashicorp/azurerm v3.5.0 (signed by HashiCorp)
Terraform has been successfully initialized!
You may now begin working with Terraform. Try running "terraform plan" to see
any changes that are required for your infrastructure. All Terraform commands
should now work.
If you ever set or change modules or backend configuration for Terraform,
rerun this command to reinitialize your working directory. If you forget, other
commands will detect it and remind you to do so if necessary.
Success! The configuration is valid.
Login Succeeded
CLI already signed in
Registering template ...
id
tre-shared-service-cyclecloud Azure CycleCloud Azure CycleCloud is an enterprise-friendly tool for orchestrating and managing High Performance Computing (HPC) environments on Azure.
make[1]: Leaving directory '/workspaces/AzureTRE-Deployment'Now the 'Azure CycleCloud' option is visible in the 'Shared Services' section of the TRE GUI. After clicking on the 'Create' button for 'Azure CycleCloud' and submitting, this error occurred:
deployment failed - There was an issue with the latest deployment or update for this resource. Please see the Operations panel within the resource for details.
Here is the content of the Operations panel:
Resource Id: ################################
Resource Path: /shared-services/################################
Resource Version: 0
Status: deployment_failed
Action: install
Message: ################################: Error message: Unable to find image 'mytreacr.azurecr.io/tre-shared-service-cyclecloud@sha256:################################' locally [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_secret" was assigned on the command line, but [31m│[0m [0mthe root module does not declare a variable of that name. To use this [31m│[0m [0mvalue, add a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_tenant_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_use_msi" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=******* -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=******* -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 Error: error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=******* -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=******* -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 1 error occurred: * mixin execution failed: package command failed /cnab/app/cnab/app/mixins/terraform/runtimes/terraform-runtime install [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_secret" was assigned on the command line, but [31m│[0m [0mthe root module does not declare a variable of that name. To use this [31m│[0m [0mvalue, add a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_tenant_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_use_msi" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=################################ -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=################################ -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 Error: error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=################################ -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=################################ -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 1 error occurred: * mixin execution failed: package command failed /cnab/app/cnab/app/mixins/terraform/runtimes/terraform-runtime install [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_secret" was assigned on the command line, but [31m│[0m [0mthe root module does not declare a variable of that name. To use this [31m│[0m [0mvalue, add a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_tenant_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_use_msi" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=################################ -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=################################ -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 Error: error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=################################ -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=################################ -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 2 errors occurred: * container exit code: 1, message: <nil> * required output connection_uri is missing and has no default ; Command executed: porter install "################################" --reference mytreacr.azurecr.io/tre-shared-service-cyclecloud:v0.5.5 --param arm_environment="public" --param arm_use_msi="true" --param azure_environment="AzureCloud" --param id="################################" --param tfstate_container_name="tfstate" --param tfstate_resource_group_name="MyTRE" --param tfstate_storage_account_name="mytrestorage" --param tre_id="mytre" --force --credential-set arm_auth --credential-set aad_auth
Created: Sun May 19 2024 05:21:32 GMT+0100 (a day ago)
Updated: Sun May 19 2024 05:23:07 GMT+0100 (a day ago)
User: My User
Steps
1) Main step for ################################
################################: Error message: Unable to find image 'mytreacr.azurecr.io/tre-shared-service-cyclecloud@sha256:################################' locally [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_secret" was assigned on the command line, but [31m│[0m [0mthe root module does not declare a variable of that name. To use this [31m│[0m [0mvalue, add a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_tenant_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_use_msi" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=******* -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=******* -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 Error: error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=******* -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=******* -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 1 error occurred: * mixin execution failed: package command failed /cnab/app/cnab/app/mixins/terraform/runtimes/terraform-runtime install [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_secret" was assigned on the command line, but [31m│[0m [0mthe root module does not declare a variable of that name. To use this [31m│[0m [0mvalue, add a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_tenant_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_use_msi" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=################################ -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=################################ -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 Error: error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=################################ -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=################################ -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 1 error occurred: * mixin execution failed: package command failed /cnab/app/cnab/app/mixins/terraform/runtimes/terraform-runtime install [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_client_secret" was assigned on the command line, but [31m│[0m [0mthe root module does not declare a variable of that name. To use this [31m│[0m [0mvalue, add a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_tenant_id" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m [31m╷[0m[0m [31m│[0m [0m[1m[31mError: [0m[0m[1mValue for undeclared variable[0m [31m│[0m [0m [31m│[0m [0m[0mA variable named "arm_use_msi" was assigned on the command line, but the [31m│[0m [0mroot module does not declare a variable of that name. To use this value, [31m│[0m [0madd a "variable" block to the configuration. [31m╵[0m[0m error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=################################ -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=################################ -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 Error: error running command /cnab/app/terraform /usr/bin/terraform apply -auto-approve -input=false -var arm_client_id=################################ -var arm_client_secret= -var arm_environment=public -var arm_tenant_id=################################ -var arm_use_msi=true -var tre_id=mytre -var tre_resource_id=################################: exit status 1 2 errors occurred: * container exit code: 1, message: <nil> * required output connection_uri is missing and has no default ; Command executed: porter install "################################" --reference mytreacr.azurecr.io/tre-shared-service-cyclecloud:v0.5.5 --param arm_environment="public" --param arm_use_msi="true" --param azure_environment="AzureCloud" --param id="################################" --param tfstate_container_name="tfstate" --param tfstate_resource_group_name="MyTRE" --param tfstate_storage_account_name="mytrestorage" --param tre_id="mytre" --force --credential-set arm_auth --credential-set aad_authAdditional information:
UI Version: 0.5.21
API Version: 0.18.5
Cosmos DB: OK
Service Bus: OK
Resource Processor: OK
Also, I tried to delete the Azure CycleCloud service using the GUI by clicking on the 'Delete' button, but this error occurred:
Deleting failed - There was an issue with the latest deployment or update for this resource. Please see the Operations panel within the resource for details.
What could be the root cause of this deployment failure? @marrobi, is this issue still open(https://github.com/microsoft/AzureTRE/issues/2406), and to have a successful deployment, do some additional ports need to be opened, or was a step missed on my side?
tim-allen-ck
commented
4 months ago hi @BiologyGeek Im looking into the issue. I believe the problem is these 4 lines in the porter.yaml file in the cyclecloud folder
arm_client_id: ${ bundle.credentials.azure_client_id }
arm_client_secret: ${ bundle.credentials.azure_client_secret }
arm_tenant_id: ${ bundle.credentials.azure_tenant_id }
arm_use_msi: ${ bundle.parameters.arm_use_msi }they need removing, then try to build and publish the service.
BiologyGeek
commented
4 months ago hi @BiologyGeek Im looking into the issue. I believe the problem is these 4 lines in the porter.yaml file in the cyclecloud folder
arm_client_id: ${ bundle.credentials.azure_client_id } arm_client_secret: ${ bundle.credentials.azure_client_secret } arm_tenant_id: ${ bundle.credentials.azure_tenant_id } arm_use_msi: ${ bundle.parameters.arm_use_msi }they need removing, then try to build and publish the service.
Thank you @tim-allen-ck!
After removing the mentioned lines from the porter.yaml file in the CycleCloud folder and running the commands, new results appeared as mentioned below.
Question: By running $ make bundle-publish and $ make bundle-register, will it override the impact of the $ make shared_service_bundle BUNDLE=cyclecloud commands that were run previously, or does something need to be manually unregistered in some way?
Result of $ make bundle-build DIR=/workspaces/AzureTRE-Deployment/AzureTRE/templates/shared_services/cyclecloud command:
Result of $ make bundle-publish DIR=/workspaces/AzureTRE-Deployment/AzureTRE/templates/shared_services/cyclecloud command:
Result of $ make bundle-register DIR=/workspaces/AzureTRE-Deployment/AzureTRE/templates/shared_services/cyclecloud BUNDLE_TYPE=cyclecloud command:
Now, from the Azure portal, by going to the TRE-associated resource group and searching 'cycle', I can see these 5 resources:
Then, I was able to uninstall the previous Azure CycleCloud shared services using the TRE GUI and then reinstall them.
Based on my understanding from the documentation, I went to:
Azure Portal --> My TRE resource group --> The virtual machine associated with CycleCloud (cyclecloud-####) --> From the left blade, click on 'Bastion' --> Then select 'Authentication Type: VM Password' and fill in the Username and VM Password from the values in 'Key Vault', then click 'Connect'.
This page appeared inside the Bastion window:
But based on the documentation, I assumed I would see a page like this:
Question: Could you please guide me on whether some deployment steps were missed or if I went to the wrong path?
tim-allen-ck
commented
4 months ago Hi @BiologyGeek
According to the docs, you'll need to head to the public url of the cyclecloud instance.
https://cyclecloud-{TRE_ID}.{LOCATION}.cloudapp.azure.com/
https://microsoft.github.io/AzureTRE/v0.16.0/tre-templates/shared-services/cyclecloud/
tim-allen-ck
commented
4 months ago Regarding
Question: By running
$ make bundle-publishand$ make bundle-register, will it override the impact of the$ make shared_service_bundle BUNDLE=cyclecloudcommands that were run previously, or does something need to be manually unregistered in some way?
It should only override if you've edited the version of the bundle in the porter.yaml
BiologyGeek
commented
3 months ago Hi @BiologyGeek According to the docs, you'll need to head to the public url of the cyclecloud instance.
https://cyclecloud-{TRE_ID}.{LOCATION}.cloudapp.azure.com/https://microsoft.github.io/AzureTRE/v0.16.0/tre-templates/shared-services/cyclecloud/
Hi @tim-allen-ck, thanks for your reply!
My source of confusion is about where I should open the URL of the CycleCloud instance because it is not accessible from the public internet. So, I assumed two potential ways:
The result of this method was a black page that shows 'OpenLogic CentOS7.9' in a terminal-like screen, as I shared above. Should I run any specific commands within this terminal window?
https://cyclecloud-mytre.eastus.cloudapp.azure.com/ in the browser.The result was:
Hmmm ... can't reach this page
cyclecloud-mytre.eastus.cloudapp.azure.com's DNS address could not be found ...
diagnosing the problem now.
Try running Windows Network Diagnostics.
DNS_PROBE_STARTED
RefreshAnd after a few seconds:
Hmmm ... can't reach this page
Check if there is a typo in cyclecloud-mytre.eastus.cloudapp.azure.com.
If spelling is correct, try running Windows Network Diagnostics.
DNS_PROBE_FINISHED_NXDOMAIN
RefreshMy question is, which method should work, the first or the second?
Update: I'm still curious about which of the two methods is correct. However, I tried another method, and it helped me view the Azure CycleCloud page in the web browser within the Data Science VM (Guacamole).
Here's what I did: Azure Portal --> My TRE resource group --> The 'Private DNS zone' associated with CycleCloud --> Copied the value of the A record, which is a private IP address -->Entered the copied private IP address into the Microsoft Edge browser running on the Data Science VM (Guacamole) within TRE.
Now I can see the Azure CycleCloud page:
The current challenge is that when I click the "Validate Credentials" button within the Add Subscription window, an error message appears:
Connection Erron: GET https//managemert.azure.com/subscriptions/###################/providers/Microsoft.Storage/storageAccounts?api-version=2019-04-01 - Remote host terminated the handshakeThe questions are:
tim-allen-ck
commented
3 months ago Hi @BiologyGeek, I'll have a look at this next week and get back to you.
BiologyGeek
commented
3 months ago Hi @BiologyGeek, I'll have a look at this next week and get back to you.
Thank you @tim-allen-ck!
These two items might be helpful for diagnostics:
This is a screenshot of the 'Network settings' window for the virtual machine associated with Azure CycleCloud within TRE:
This is a screenshot of the 'Private DNS zone' resource associated with Azure CycleCloud within TRE:
Update: Whitelisting these ports (22, 111, 2049, 80, 443) (https://github.com/microsoft/AzureTRE/issues/2406) for both inbound and outbound for any protocol on a Network Security Group named 'nsg-default-rules' didn't help resolve those two issues:
BiologyGeek
commented
3 months ago Team, are there any other tests or scenarios that I can run to make troubleshooting easier? If so, please kindly provide some insights so I can perform the tests and share the results.
tim-allen-ck
commented
3 months ago hi @BiologyGeek, sorry it's taken a while. I think I've fixed the management API issue, looks like it needs an extra rule in the firewall to allow 80 and 443 access to the management.azure.com fqdn
also as per the docs I've been testing this in the admin VM which I connected to via Bastion and that seems to work using the private dns address and that seems to be working
BiologyGeek
commented
3 months ago hi @BiologyGeek, sorry it's taken a while. I think I've fixed the management API issue, looks like it needs an extra rule in the firewall to allow 80 and 443 access to the management.azure.com fqdn
Thank you @tim-allen-ck! How can I replicate this configuration on my end? I went to the following paths but couldn't find the appropriate section to whitelist those two ports for management.azure.com:
Should I edit something in the source code and then run the $ make all command?
tim-allen-ck
commented
3 months ago I added an Application rule to the arc-shared-subnet rule collection in the firewall policy manually.
There's some work to edit the template to add these changes and the other fw changes into it. Plus the initial porter.yaml file changes.
BiologyGeek
commented
2 months ago I added an Application rule to the
arc-shared-subnetrule collection in the firewall policy manually. There's some work to edit the template to add these changes and the other fw changes into it. Plus the initial porter.yaml file changes.
Thank you @tim-allen-ck! It worked! Now Azure CycleCloud can identify resources within the subscription. However, another challenge arose during the Slurm configuration, which is described here: https://github.com/microsoft/AzureTRE/issues/4021 Could you please take a look and provide your insight?
marrobi
commented
1 day ago Fixed in #4050
Hello team,
I wanted to deploy Azure CycleCloud and have referred to this document. However, I encountered some confusion while attempting to deploy this service. After running the relevant command to approve the license terms, I tried the following commands using a dev container but without success:
The document states:
I am wondering which method is correct for registering this service. What went wrong? Is this method correct, or did I miss something?
Also, by opening this URL (https://cyclecloud-{My-Own-TRE_ID}.{My-Selected-LOCATION}.cloudapp.azure.com/) in the web browser of a virtual machine, the browser displays the 'DNS_PROBE_FINISHED_NXDOMAIN' error.