Closed timothycarambat closed 9 months ago
@timothycarambat This environment variable only affects the compilation of llama.cpp
; setting it in runtime like the example you provided is not supported.
There's already documentation for this environment variable here.
Thanks for the contribution anyway :)
@timothycarambat node-llama-cpp
builds llama.cpp
at runtime only if no binaries are available.
It looks to you that this code works because you run it locally on a dev environment that doesn't have any pre-built binaries.
It won't work on a second run or on the module that's uploaded to npm
Description of change
Update the documentation of enabling or disabling metal support via the
NODE_LLAMA_CPP_METAL
environment variable. The current example only shows how to disable metal support when buildingllama.cpp
bindings via the CLI command.Pull-Request Checklist
master
branchnpm run format
to apply eslint formattingnpm run test
passes with this changeFixes #0000
N/A