withcatai / node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
https://withcatai.github.io/node-llama-cpp/
MIT License
735 stars 63 forks source link

feat: improve grammar support #215

Closed giladgd closed 1 month ago

giladgd commented 1 month ago

Description of change

Pull-Request Checklist