Closed jonaszbigda closed 4 months ago
Nevermind, found it. For anyone that also can't find them: You need to install CUDA Toolkit (for this plugin it's version 12.2), and then they're located in the toolkit directory (default "C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.2/lib/x64")
If I build a package with this plugin as a dependency, is there support for pulling in system dependencies like cuda?
Related to https://github.com/getnamo/Llama-Unreal/issues/7, the plugin isn't properly portable at this time due to dependency not working on a separate machine if compiled on a different one. Likely needs a dynamic dll style llama.cpp build vs a static one. Cuda dependencies can in theory be copies, but their distribution is bound under Nvidia terms, see their toolkit for details.
Where can i find those cudart.lib / cublas.lib / cuda.lib files? They're not anywhere in the plugin folder, or llama repo.