Open liuye1992 opened 2 weeks ago
Have you tried using the latest version? 0.6.2 is from a very long time ago.
Have you tried using the latest version? 0.6.2 is from a very long time ago.
Several hours ago I installed the lastest version and run it successfully on powershell, but some warinings were outputted and GPU was unable to be used for Model training and inference still.
seems the reason is CUDA SDK called by ggml-cuda.dll library cannot find any GPU devices.
Warining information below:
“ ggml_cuda_link: welcome to CUDA SDK with tinyBLAS link_cuda_dso: No GPU devices found ”
Contact Details
No response
What happened?
Recording to some warnings (such as:get_nvcc_path: note: /usr/local/cuda/bin/nvcc.exe does not exist) outputted by the log uploaded, seems llamafile with --gpu only tries to screen CUDA installation location of Linux OS.
So how to specify the one i want from two GC on Windows?
Version
llamafile-0.6.2.exe CUDA Version: 11.7 GTX 1650 4G
What operating system are you seeing the problem on?
Windows
Relevant log output