Where to find cuda static libs?

getnamo / Llama-Unreal

Llama.cpp plugin for Unreal Engine 5

MIT License

41 stars 5 forks source link

Where to find cuda static libs? #15

Closed jonaszbigda closed 4 months ago

jonaszbigda commented 4 months ago

Where can i find those cudart.lib / cublas.lib / cuda.lib files? They're not anywhere in the plugin folder, or llama repo.

jonaszbigda commented 4 months ago

Nevermind, found it. For anyone that also can't find them: You need to install CUDA Toolkit (for this plugin it's version 12.2), and then they're located in the toolkit directory (default "C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.2/lib/x64")

alando46 commented 2 months ago

If I build a package with this plugin as a dependency, is there support for pulling in system dependencies like cuda?

getnamo commented 2 months ago

Related to https://github.com/getnamo/Llama-Unreal/issues/7, the plugin isn't properly portable at this time due to dependency not working on a separate machine if compiled on a different one. Likely needs a dynamic dll style llama.cpp build vs a static one. Cuda dependencies can in theory be copies, but their distribution is bound under Nvidia terms, see their toolkit for details.