issues
search
withcatai
/
node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
https://withcatai.github.io/node-llama-cpp/
MIT License
760
stars
65
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
other people's gguf file can not run
#124
xuedaobian
closed
7 months ago
2
feat: get embedding for text
#123
giladgd
closed
6 months ago
2
No CUDA toolset found Error even its Found CUDAToolkit
#122
sooraj007
closed
7 months ago
3
Naming the `LlamaModel` anything but `model`makes the app crash when creating a new `LlamaContext`
#120
stduhpf
closed
7 months ago
1
feat: minP support
#119
stduhpf
closed
5 months ago
1
fix: adapt to breaking changes of `llama.cpp`
#117
giladgd
closed
7 months ago
2
bug: model parameter `threads` doesn't work
#114
pafik13
closed
6 months ago
4
node-llama-cpp doesn`t work with typescript
#113
eugene-kirnasuk
closed
7 months ago
3
docs(README): add v3.0 beta
#110
giladgd
closed
7 months ago
2
docs: Update documentation on metal support via NODE_LLAMA_CPP_METAL env
#108
timothycarambat
closed
7 months ago
2
feat: hide llama.cpp logs
#106
ExposedCat
closed
5 months ago
2
feat: version 3.0
#105
giladgd
opened
8 months ago
19
feat: automatic batching
#104
giladgd
closed
8 months ago
3
feat: Apply different LoRA dynamically
#103
snowyu
closed
2 months ago
11
feat: function calling support in a chat session's `prompt` function
#101
giladgd
closed
6 months ago
2
support commonjs
#100
mainfraame
closed
8 months ago
4
fix package.json to use module instead of main
#99
mainfraame
closed
8 months ago
4
`(node:23396) UnhandledPromiseRejectionWarning: Error: AbortError`
#95
jparismorgan
closed
8 months ago
1
feat: export `llama.cpp` release info
#91
giladgd
closed
8 months ago
1
docs(README): add roadmap links, improve `README.md`
#90
giladgd
closed
8 months ago
1
feat: `create-project` command to make it easier to bootstrap a new project
#89
giladgd
closed
2 months ago
1
feat: pass an image as part of the evaluation
#88
giladgd
opened
8 months ago
4
feat: use multiple machines for evaluating large models that require a lot of RAM
#86
giladgd
opened
8 months ago
0
feat: automatic batching
#85
giladgd
opened
8 months ago
8
Please add AMD ROCm support
#84
zxcvxzcv-johndoe
closed
8 months ago
8
fix: bugs
#80
giladgd
closed
9 months ago
1
Not worlking as intended.
#79
arthurwolf
closed
9 months ago
3
CUDA compilation failing with VS 2022 Community
#78
ThomasVuillaume
closed
9 months ago
7
A way to get the answer while it's generating.
#75
pierrbt
closed
9 months ago
1
Error building with Cuda
#74
TillWege
closed
9 months ago
1
docs(README): add social poster
#73
giladgd
closed
9 months ago
1
feat(minor): save and load history to `chat` command
#71
giladgd
closed
9 months ago
1
fix: `GeneralChatPromptWrapper` output
#70
giladgd
closed
9 months ago
1
fix: improve JSON schema validation error messages
#69
giladgd
closed
9 months ago
1
feat: add JSON schema grammar support
#68
giladgd
closed
9 months ago
1
fix: improve CUDA compilation
#66
giladgd
closed
9 months ago
1
fix: add documentation to Google Search
#65
giladgd
closed
9 months ago
1
fix: git bundle info for build
#64
giladgd
closed
9 months ago
1
docs(README): add changelog link
#63
giladgd
closed
9 months ago
1
feat: new documentation website
#62
giladgd
closed
9 months ago
1
feat: git release bundle
#61
giladgd
closed
9 months ago
1
feat: adapt to `llama.cpp` changes, repeat penalty, improved grammar
#60
giladgd
closed
9 months ago
1
ggml_allocr_alloc: not enough space in the buffer
#59
Pixelycia
closed
9 months ago
8
Error [ERR_REQUIRE_ESM]: require() of ES Module
#58
gbourgeat
closed
9 months ago
5
Set repeat-penalty request
#57
v4lentin1879
closed
9 months ago
1
fix: make disabling metal on build work
#55
giladgd
closed
10 months ago
1
feat: fall back to build from source if prebuilt binary loading fails
#54
giladgd
closed
10 months ago
1
feat: add `FalconChatPromptWrapper`
#53
giladgd
closed
10 months ago
1
docs: improve CUDA documentation
#52
giladgd
closed
10 months ago
1
feat: load conversation history into a `LlamaChatSession`
#51
giladgd
closed
10 months ago
1
Previous
Next