Closed Michaelvll closed 9 months ago
@Michaelvll have you resolved it?
Thanks for pinning this @yangyingxiang! Currently we did not figure out the reason for this yet. It seems to be an issue with Azure's GPU setup, and we found people also experiencing this issue: https://github.com/NVIDIA/nccl/issues/1101.
We will keep an eye on this issue, and see if there is some possible reason. Please let us know if you are able to find some solution. : )
sky launch --disk-tier none -c test-mixtral --cloud azure llm/mixtral/serve.yaml