issues
search
Atome-FE
/
llama-node
Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
https://llama-node.vercel.app/
Apache License 2.0
865
stars
63
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
req: support async/await
#68
ralyodio
opened
1 year ago
8
Error: Failed to convert napi value Function into rust type `f64`
#67
ralyodio
opened
1 year ago
5
feat: update cuda dynamic compiling
#66
hlhr202
closed
1 year ago
0
is this supposed to have a gpu to run?
#64
ralyodio
closed
1 year ago
2
feat: implement chat feature to rwkv
#63
yorkzero831
closed
1 year ago
2
feat: upgrade llama-rs to llm
#62
hlhr202
closed
1 year ago
0
update: sync latest llama.cpp branch
#61
hlhr202
closed
1 year ago
0
Unable to load latest GGML models using llama.cpp after latest quantisation changes
#60
dev-bre
closed
1 year ago
3
feat: impl abortable inference
#58
hlhr202
closed
1 year ago
0
[Error: Could not load model] { code: 'GenericFailure' }
#57
ralyodio
opened
1 year ago
8
langchain integration
#56
luca-saggese
opened
1 year ago
2
basic unified API for all backends
#55
end-me-please
opened
1 year ago
3
¿Update cross-compile.mts with aarch64 architecture?
#54
yupihello
opened
1 year ago
1
How to train the model with this library?
#53
dev-bre
closed
1 year ago
1
feature: implemented parallel inference for llama-rs, implemented naive sequential async inference for llama-cpp and rwkv-cpp
#52
hlhr202
closed
1 year ago
0
feature: impl naive gpt2
#51
hlhr202
closed
1 year ago
0
How to use the GPU?
#50
dev-bre
closed
1 year ago
16
fix: utf8 encode issue
#49
yorkzero831
closed
1 year ago
2
fix: rwkv cpp windows failing
#48
hlhr202
closed
1 year ago
7
Interactive
#47
luca-saggese
opened
1 year ago
11
fix: fix the problem of rwkv failing
#46
yorkzero831
closed
1 year ago
0
@llama-node/rwkv-cpp only contains rwkv-cpp.darwin-arm64.node
#44
yorkzero831
closed
1 year ago
13
Version 0.0.34 gives drastic different ouput when paired with vicuna.
#43
JoshuaeKaiser
opened
1 year ago
3
feat: temp workaround for cublas build
#42
hlhr202
closed
1 year ago
0
How do I force the end of text generation?
#41
MrShitFox
opened
1 year ago
16
Typo fix
#40
Dinex-dev
closed
1 year ago
1
feat: new inference resolve/reject type
#39
hlhr202
closed
1 year ago
0
feature: llama cpp new sampling
#38
hlhr202
closed
1 year ago
0
implement new sampling logic for llama.cpp
#36
hlhr202
closed
1 year ago
0
feat: impl cache session and load session
#35
hlhr202
closed
1 year ago
1
[ASK] enable cuda with manual compilation
#34
tchereau
opened
1 year ago
10
feat: impl session snapshot, add comments for llama-rs params
#33
hlhr202
closed
1 year ago
0
Failed to load modal
#32
Bazhan4ik
closed
1 year ago
5
feature: rwkv cpp backend
#31
hlhr202
closed
1 year ago
0
Get started guideline for contributors
#30
hlhr202
closed
1 year ago
1
chore: add more docs
#29
hlhr202
closed
1 year ago
0
feature: move docs into codebase
#28
hlhr202
closed
1 year ago
0
feat: upgrade to newest llama-rs so that we can support ggjt model
#27
hlhr202
closed
1 year ago
0
Expand on install/usage instructions
#26
bakman2
closed
1 year ago
2
fix: ci cross compile failure report
#25
hlhr202
closed
1 year ago
0
Support for Prompt Caching/Restoring from llama-rs?
#24
end-me-please
closed
1 year ago
14
llama-node does not display prompt in Deno environment
#23
KiraCoding
closed
1 year ago
2
"libstdc++.so.6: version `GLIBCXX_3.4.29' not found" error with docker
#22
MegaR
closed
1 year ago
5
dyld[50013]: missing symbol called
#21
Hoozia
closed
1 year ago
11
feat: maintain llama.cpp bindings locally.
#20
hlhr202
closed
1 year ago
0
feat: add linux-musl build
#19
hlhr202
closed
1 year ago
0
zsh: illegal hardware instruction
#18
loretoparisi
closed
1 year ago
6
refractor: refine types
#16
hlhr202
closed
1 year ago
0
chore: update llama-cpp readme
#15
hlhr202
closed
1 year ago
0
Feature/llama cpp embedding and tokenization support
#14
hlhr202
closed
1 year ago
0
Previous
Next