When trying to build with Cuda support on the current version, CMake seems unable to find the CUDA toolkit:
D:\Projekte\ai-test\node_modules\node-llama-cpp\llama\build\CMakeFiles\3.26.4\VCTargetsPath.vcxproj" (default target) (1) -
(PrepareForBuild target) ->
D:\Software\Microsoft Visual Studio\2022\MSBuild\Microsoft\VC\v170\Microsoft.CppBuild.targets(456,5): error MSB8020: The build tools for C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2 (Platform Toolset = 'C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2') cannot be found. To build using the C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2 build tools, please install C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2 build tools. Alternatively, you may upgrade to the current Visual Studio tools by selecting the Project menu or right-click the solution, and then selecting "Retarget solution". [D:\Projekte\ai-test\node_modules\node-llama-cpp\llama\build\CMakeFiles\3.26.4\VCTargetsPath.vcxproj]
When trying to build LLama.cpp itself with Cuda support it works without any problem.
Steps to reproduce
initialize a new node project by running npm init
add the dependancy by running npm install node-llama-cpp
try to compile with cuda support npx node-llama-cpp download --cuda
My Environment
Dependency
Version
Operating System
Windows 11
CPU
Ryzen 7 7800x3d
Node.js version
18.6
node-llama-cpp version
b1378
Additional Context
No response
Relevant Features Used
[ ] Metal support
[X] CUDA support
[ ] Grammar
Are you willing to resolve this issue by submitting a Pull Request?
Yes, I have the time, but I don't know how to start. I would need guidance.
This issue was already solved as part of #66.
Update to the latest version of node-llama-cpp and try again.
If the issue still persists, let me know and I'll reopen this issue.
Issue description
Can't build executable with Cuda support enabled
Expected Behavior
Running
npx node-llama-cpp download --cuda
should compile the release with cuda supportActual Behavior
When running Version 2.5.0 of the Package the build process seems to fail, but the nvidia Toolkit can be found:
When trying to build with Cuda support on the current version, CMake seems unable to find the CUDA toolkit:
When trying to build LLama.cpp itself with Cuda support it works without any problem.
Steps to reproduce
npm init
npm install node-llama-cpp
npx node-llama-cpp download --cuda
My Environment
node-llama-cpp
versionAdditional Context
No response
Relevant Features Used
Are you willing to resolve this issue by submitting a Pull Request?
Yes, I have the time, but I don't know how to start. I would need guidance.