issues
search
withcatai
/
node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
https://node-llama-cpp.withcat.ai
MIT License
829
stars
80
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
feat: automatic batching
#85
giladgd
opened
10 months ago
8
Please add AMD ROCm support
#84
zxcvxzcv-johndoe
closed
9 months ago
8
fix: bugs
#80
giladgd
closed
10 months ago
1
Not worlking as intended.
#79
arthurwolf
closed
10 months ago
3
CUDA compilation failing with VS 2022 Community
#78
ThomasVuillaume
closed
10 months ago
7
A way to get the answer while it's generating.
#75
pierrbt
closed
10 months ago
1
Error building with Cuda
#74
TillWege
closed
10 months ago
1
docs(README): add social poster
#73
giladgd
closed
11 months ago
1
feat(minor): save and load history to `chat` command
#71
giladgd
closed
11 months ago
1
fix: `GeneralChatPromptWrapper` output
#70
giladgd
closed
11 months ago
1
fix: improve JSON schema validation error messages
#69
giladgd
closed
11 months ago
1
feat: add JSON schema grammar support
#68
giladgd
closed
11 months ago
1
fix: improve CUDA compilation
#66
giladgd
closed
11 months ago
1
fix: add documentation to Google Search
#65
giladgd
closed
11 months ago
1
fix: git bundle info for build
#64
giladgd
closed
11 months ago
1
docs(README): add changelog link
#63
giladgd
closed
11 months ago
1
feat: new documentation website
#62
giladgd
closed
11 months ago
1
feat: git release bundle
#61
giladgd
closed
11 months ago
1
feat: adapt to `llama.cpp` changes, repeat penalty, improved grammar
#60
giladgd
closed
11 months ago
1
ggml_allocr_alloc: not enough space in the buffer
#59
Pixelycia
closed
10 months ago
8
Error [ERR_REQUIRE_ESM]: require() of ES Module
#58
gbourgeat
closed
11 months ago
5
Set repeat-penalty request
#57
v4lentin1879
closed
11 months ago
1
fix: make disabling metal on build work
#55
giladgd
closed
11 months ago
1
feat: fall back to build from source if prebuilt binary loading fails
#54
giladgd
closed
11 months ago
1
feat: add `FalconChatPromptWrapper`
#53
giladgd
closed
11 months ago
1
docs: improve CUDA documentation
#52
giladgd
closed
11 months ago
1
feat: load conversation history into a `LlamaChatSession`
#51
giladgd
closed
11 months ago
1
feat: only build one binary for all node versions
#50
giladgd
closed
11 months ago
1
fix: adapt to `llama.cpp` interface change
#49
giladgd
closed
11 months ago
1
docs: fix typo in CONTRIBUTING.md
#48
ido-pluto
closed
11 months ago
1
ci: run workflows also on PRs from forked repos
#47
giladgd
closed
11 months ago
1
fix: cmake compile args error
#44
cmeka
closed
11 months ago
2
fix: cmake compile args error
#43
cmeka
closed
11 months ago
1
docs: improve contributing docs
#42
giladgd
closed
11 months ago
1
Llama2 Template Error
#41
saul-jb
closed
11 months ago
2
Error when compiling with CUDA on Windows
#40
BennyH26
closed
11 months ago
4
Add method for dumping context and loading it.
#39
saul-jb
closed
11 months ago
2
feat: use `cmake` instead of `node-gyp`
#37
giladgd
closed
12 months ago
1
OMG Thank you
#36
koolamusic
closed
10 months ago
0
fix: load image urls properly also outside GitHub
#35
giladgd
closed
1 year ago
1
docs(README): improve `README.md` formatting and add images
#34
giladgd
closed
1 year ago
1
feat: `threads` count setting on a model
#33
giladgd
closed
1 year ago
1
fix: handle stop words remainder properly in a chat session
#32
giladgd
closed
1 year ago
1
fix: move default to the last in package.json
#31
itsuka-dev
closed
1 year ago
2
Module not found: Default condition should be last one
#30
itsuka-dev
closed
1 year ago
1
feat: export class options types
#29
giladgd
closed
1 year ago
1
feat: make contributions and support more efficient via GitHub templates
#28
giladgd
closed
1 year ago
1
feat: improve error message when `llama.cpp` source is not downloaded
#27
giladgd
closed
1 year ago
1
Error: Command npm run -s node-gyp-llama -- configure --arch=arm64 --target=v18.0.0 exited with code 1
#26
loretoparisi
closed
11 months ago
5
Failed to fetch llama.cpp release info RequestError [HttpError]: Not Found
#25
loretoparisi
closed
1 year ago
2
Previous
Next