withcatai / node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
https://node-llama-cpp.withcat.ai
MIT License
894 stars 86 forks source link

fix: more cases of unknown characters in generation streaming #295

Closed giladgd closed 1 month ago

giladgd commented 1 month ago

Description of change

Fixes #284

Pull-Request Checklist

github-actions[bot] commented 1 month ago

:tada: This PR is included in version 3.0.0-beta.43 :tada:

The release is available on:

Your semantic-release bot :package::rocket:

github-actions[bot] commented 1 week ago

:tada: This PR is included in version 3.0.0 :tada:

The release is available on:

Your semantic-release bot :package::rocket: