Closed juanmf closed 9 months ago
Changed 1st line in Dockerfile and it's looking good.
https://github.com/mistralai/mistral-src/blob/147c4e68279b90eb61b19bdea44e16f5539d5a5d/deploy/Dockerfile#L1
to: FROM --platform=amd64 nvcr.io/nvidia/cuda:12.1.0-devel-ubuntu22.04 as base
=> [internal] load metadata for nvcr.io/nvidia/cuda:12.1.0-devel-ubuntu22.04 1.8s
=> [1/8] FROM nvcr.io/nvidia/cuda:12.1.0-devel-ubuntu22.04@sha256:e3a8f7b933e77ecee74731198a2a5483e965b585cea2660675cf4bb152237e9b 236.0s
=> => resolve nvcr.io/nvidia/cuda:12.1.0-devel-ubuntu22.04@sha256:e3a8f7b933e77ecee74731198a2a5483e965b585cea2660675cf4bb152237e9b
...
=> [5/8] RUN git clone https://github.com/NVIDIA/apex && cd apex && git checkout 2386a912164b0c5cfcd8be7a2b890fbac5607c82 && sed -i '/check_cuda_torch_binary_vs_bare_metal(CUDA_HOME)/d' 1311.1s
Running...
Looks like lines FROM --platform=amd64 nvcr.io/nvidia/cuda:11.8.0-devel-ubuntu22.04 as base
& RUN pip3 install "torch>=2.0.0"
is bound to cause this issue as torch keeps having upgrades.
that was it
Am I supposed to install CUDA 1st? does it make sense in a MacBook Pro 2017?
trying
$ export TORCH_CUDA_ARCH_LIST="8.0"
didn't help.