BREAKING CHANGE!: binding for node-llama-cpp (v1) dropped - Githubissues

withcatai / catai

Run AI ✨ assistant locally! with simple API for Node.js 🚀

https://withcatai.github.io/catai/

MIT License

450 stars 29 forks source link

BREAKING CHANGE!: binding for node-llama-cpp (v1) dropped #46

Closed ido-pluto closed 1 year ago

ido-pluto commented 1 year ago

Description of change

Remove support for GGML format. GGML format has long been deprecated and offers significantly worse performance compared to GGUF.
Better API documentation
Shorter model name in directory (.model removed)

Pull-Request Checklist

[x] Code is up-to-date with the main branch
[ ] This pull request links relevant issues as Fixes #0000
[x] Documentation has been updated to reflect this change
[x] The new commits follow conventions explained in CONTRIBUTING.md

BREAKING CHANGE!: Remove support for GGML format

github-actions[bot] commented 1 year ago

:tada: This PR is included in version 3.0.0 :tada:

The release is available on:

Your semantic-release bot :package::rocket: