skypilot-org / skypilot

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
https://skypilot.readthedocs.io
Apache License 2.0
6.75k stars 503 forks source link

Cannot choose Custom V-net and custom images in Azure #2910

Open Kenadyi opened 10 months ago

Kenadyi commented 10 months ago

I cannot choose Custom V-net and custom images in Azure, is there a specific format I have to use, or is the feature not available for Azure?

(sky) skypilot@kenadyinampudi:$ sky launch skypilot_azure.yaml ValueError: Invalid config YAML (/home/skypilot/.sky/config.yaml): The following fields are invalid: Found unsupported field 'azure'. (sky) skypilot@kenadyinampudi:$ sky launch skypilot_azure.yaml Task from YAML spec: skypilot_azure.yaml ValueError: image_id is only supported for AWS/GCP/IBM/OCI, please explicitly specify the cloud. (sky) skypilot@kenadyinampudi:~$

Michaelvll commented 10 months ago

Thanks for raising the issue @Kenadyi!

It seems there are two major TODOs:

concretevitamin commented 7 months ago

[ ] image_id support for Azure, like what we have for AWS/GCP.

Another user bumped this.

concretevitamin commented 7 months ago
  • [ ] Custom V-net (VPC) support for Azure, similar to what we support for AWS/GCP

This seems still open.

hsharifi7 commented 5 months ago

I have the same issue.

github-actions[bot] commented 1 month ago

This issue is stale because it has been open 120 days with no activity. Remove stale label or comment or this will be closed in 10 days.

tomkukral commented 6 days ago

Is there any progress on this? Can I help with implementing support for custom vnet in Azure?

concretevitamin commented 6 days ago

@tomkukral would love your help on this! You could search for vpc_name in https://github.com/skypilot-org/skypilot/blob/master/sky/provision/aws/config.py and see how it's plumbed from ~/.sky/config.yaml to AWS SDK calls. This should be added similarly to https://github.com/skypilot-org/skypilot/tree/master/sky/provision/azure.