feat: gguf parser - Githubissues

withcatai / node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

MIT License

760 stars 65 forks source link

Description of change

Add the ability to parse GGUF metadata from a local/remote file quickly and get insights based on the metadata such as the amount of VRAM required to run this model and more...

Pull-Request Checklist

[x] Code is up-to-date with the beta branch
[x] npm run format to apply eslint formatting
[x] npm run test passes with this change
[ ] This pull request links relevant issues as Fixes #0000
[x] There are new or updated unit tests validating the change
[ ] Documentation has been updated to reflect this change
[x] The new commits and pull request title follow conventions explained in pull request guidelines (PRs that do not follow this convention will not be merged)

withcatai / node-llama-cpp

feat: gguf parser #168

Description of change

Pull-Request Checklist