withcatai / node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
https://node-llama-cpp.withcat.ai
MIT License
829 stars 80 forks source link

fix: adapt to breaking changes of `llama.cpp` #117

Closed giladgd closed 9 months ago

giladgd commented 9 months ago

Description of change

Fixes #116

Pull-Request Checklist

github-actions[bot] commented 9 months ago

🎉 This PR is included in version 2.8.2 🎉

The release is available on:

Your semantic-release bot :package::rocket:

github-actions[bot] commented 7 months ago

:tada: This PR is included in version 3.0.0-beta.2 :tada:

The release is available on:

Your semantic-release bot :package::rocket: