skypilot-org / skypilot

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
https://skypilot.readthedocs.io
Apache License 2.0
6.81k stars 513 forks source link

[Storage] set_storage_mounts not working in python API #4315

Open romilbhardwaj opened 1 week ago

romilbhardwaj commented 1 week ago

Minimal repro:

import sky

resources = sky.Resources(cloud=sky.clouds.AWS())
t = sky.Task(run='ls -l /mydir')
t = t.set_resources(resources)
s = sky.Storage(source='s3://fah-public-data-covid19-cryptic-pockets', mode=sky.StorageMode.MOUNT)
t = t.set_storage_mounts({'/mydir': s})
sky.launch(t, cluster_name='test')

/mydir is not mounted to the remote VM. Provisioning logs do not have any mounting step.