Closed yika-luo closed 3 weeks ago
Thanks for adding this @yika-luo! Could we test the speed up with
--system-site-packages
removed from our setup script in #4168? I suspect the speed up would be more significant.Also, it is a bit surprising that the provisioning for CPU is longer than GPU. Is it because the CPU image is larger than GPU image? If so, maybe we should move to
ubuntu
base image instead.
Oh I ran CPU on my macbook.. I ran again on the same GPU instance and refreshed the result. They look comparable now.
I also tested removing --system-site-packages
and it only gained 1s, but at least no regression :)
This PR depends on https://github.com/skypilot-org/skypilot-catalog/pull/98
Impact of this change:
setup.py
the single source of truth of sky dependenciesTested (run the relevant ones):
./skypilot-k8s-image.sh -p -l -r ${REGION}
--> change local catalog -->sky local up
-->sky launch --cloud=kubernetes
pytest tests/test_smoke.py::test_minimal --kubernetes