issues
search
withcatai
/
node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
https://withcatai.github.io/node-llama-cpp/
MIT License
736
stars
63
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Inconsistent tokenization/encoding
#186
StrangeBytesDev
closed
3 months ago
3
fix: adapt to breaking `llama.cpp` changes
#183
giladgd
closed
3 months ago
2
feat: automatically adapt to current free VRAM state
#182
giladgd
closed
3 months ago
1
feat: Windows on Arm prebuilt binary
#181
giladgd
closed
3 months ago
1
Support file based prompt caching
#180
StrangeBytesDev
opened
3 months ago
11
feat: async operations
#178
giladgd
closed
3 months ago
1
feat: use the best compute layer available by default
#175
giladgd
closed
4 months ago
1
style: improve eslint config
#172
giladgd
closed
4 months ago
1
feat: Vulkan support
#171
giladgd
closed
4 months ago
1
fix: asset links
#170
giladgd
closed
4 months ago
2
EOS token is not detected properly for some models after upgrading to v3.0
#169
ruochenjia
closed
4 months ago
2
feat: gguf parser
#168
ido-pluto
closed
4 months ago
1
chore: remove Git LFS because it's expensive for open-source projects
#167
giladgd
closed
4 months ago
2
fix: adapt to `llama.cpp` breaking changes
#166
giladgd
closed
4 months ago
2
feat: export `resolveChatWrapperBasedOnWrapperTypeName`
#165
giladgd
closed
4 months ago
1
feat: completion and infill
#164
giladgd
closed
4 months ago
1
Grammars folder not found
#163
ExcessionEleven
closed
4 months ago
4
feat: minP support
#162
giladgd
closed
4 months ago
1
feat: get VRAM state
#161
giladgd
closed
4 months ago
1
Fail to run in docker image
#160
igorjos
closed
4 months ago
6
docs(README): update version 3 features
#158
giladgd
closed
5 months ago
2
fix: don't block a node process from exiting
#157
giladgd
closed
5 months ago
1
fix: clone from bundle
#156
giladgd
closed
5 months ago
1
fix: build and postinstall bug
#155
giladgd
closed
5 months ago
1
fix: release config
#154
giladgd
closed
5 months ago
1
feat: manual binding loading
#153
giladgd
closed
5 months ago
1
Bun support
#152
mnlttt
closed
5 months ago
1
ESM support?
#151
jacoblee93
closed
4 months ago
3
fix: build Metal by default for Apple silicone devices
#150
giladgd
closed
5 months ago
1
feat(minor): add more flags to the `chat` command
#149
giladgd
closed
5 months ago
1
Revert "feat(minor): add more flags to the `chat` command"
#148
giladgd
closed
5 months ago
0
feat(minor): add more flags to the `chat` command
#147
giladgd
closed
5 months ago
1
CLI does not work with Bun
#146
drschwabe
closed
5 months ago
1
feat(minor): add `--batchSize` and `--promptFile` options to the `chat` CLI command
#145
stewartoallen
closed
5 months ago
1
feat: get embedding for text
#144
giladgd
closed
5 months ago
1
docs(README): update version 3 beta message
#143
giladgd
closed
5 months ago
2
feat: show `llama.cpp` release in GitHub releases
#142
giladgd
closed
5 months ago
1
Add llama.cpp build number as info
#141
nathanlesage
closed
5 months ago
3
feat: function calling
#139
giladgd
closed
5 months ago
2
feat(minor): add `--printTimings` option to the `chat` CLI command
#138
JonHolman
closed
5 months ago
4
Could not find a KV slot
#136
Zambonilli
closed
5 months ago
6
Issue with Webpack Compilation
#135
nathanlesage
closed
1 month ago
9
feat: max GPU layers param
#133
quidmonkey
closed
3 months ago
1
langchain.js - throws error "disposed undefined"
#132
mrddter
closed
5 months ago
1
docs: fix code example
#131
scenaristeur
closed
6 months ago
2
docs: cannot read properties of undefined (reading '_chatGrammar') on penalty example
#130
scenaristeur
closed
6 months ago
2
Node exits when n_tokens <= n_batch
#129
platypii
closed
6 months ago
1
get embedding for text
#128
jlabrada71
closed
6 months ago
1
fix: optional typescript peer dependency
#127
giladgd
closed
6 months ago
2
feat: reuse context for different chat session history
#125
sooraj007
closed
6 months ago
4
Previous
Next