skypilot-org / skypilot

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
https://skypilot.readthedocs.io
Apache License 2.0
6.81k stars 513 forks source link

[Core] Add `NO_UPLOAD` for `remote_identity` #4307

Closed romilbhardwaj closed 6 days ago

romilbhardwaj commented 1 week ago

User reported they are using an external mechanism to inject AWS credentials in their k8s pods, which should be used for accessing buckets. However, we upload AWS credentials from the local machine if they exist, and as a result these local user credentials were overriding the injected credentials.

This PR adds a NO_UPLOAD flag to remote_identity, to explicitly skip uploading cloud credentials even if they exist on the local machine.