issues
search
Atome-FE
/
llama-node
Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
https://llama-node.vercel.app/
Apache License 2.0
862
stars
62
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
What files are compatible?
#124
bedcoding
opened
6 months ago
0
Alternative?
#123
linonetwo
opened
9 months ago
1
GGUF support?
#122
nildotdev
opened
10 months ago
0
cannot use RWKV models
#121
rozek
opened
10 months ago
16
Instructions for use with Electron
#120
bishwenduk029
opened
11 months ago
0
Time printings are gone
#119
CodeJjang
opened
1 year ago
0
napi: not found on debian bullseye
#118
loretoparisi
opened
1 year ago
5
The requested module 'llama-node/dist/llm/llama-cpp.js' does not provide an export named 'LoadConfig'
#117
heaversm
opened
1 year ago
0
Can't run example on llama-2-13b-chat q4_0
#116
gioragutt
opened
1 year ago
2
Support for passing grammars
#115
arthurwolf
opened
1 year ago
0
GPU version build not using GPU
#114
dspasyuk
opened
1 year ago
11
Segmentation fault
#113
ZGltYQ
opened
1 year ago
1
chore(deps-dev): bump vite from 4.3.1 to 4.3.9
#112
dependabot[bot]
opened
1 year ago
0
chore(deps-dev): bump semver from 7.5.0 to 7.5.2
#111
dependabot[bot]
opened
1 year ago
0
[Error: Failed to get embeddings] { code: 'GenericFailure' }
#110
ThomasDev28
opened
1 year ago
0
fatal runtime error: Rust cannot catch foreign exceptions
#109
HolmesDomain
opened
1 year ago
5
Llama2 quantized q5_1
#108
HolmesDomain
opened
1 year ago
1
Discord Access
#107
HolmesDomain
closed
1 year ago
1
Upgrade llama-cpp to master-294f424
#106
fardjad
closed
1 year ago
1
Use custom tokenizer
#105
linonetwo
opened
1 year ago
0
中文乱码
#104
linonetwo
opened
1 year ago
0
Should bring details in error message
#102
linonetwo
opened
1 year ago
0
Unsupported file version 101 when loading rwkv
#101
linonetwo
opened
1 year ago
0
Issue to build GPU version
#99
dspasyuk
closed
1 year ago
1
Resolved #91, fixed LoadModel typo
#98
tommoffat
closed
1 year ago
0
Support for the new k-quant methods in Llama.cpp
#95
synw
opened
1 year ago
0
the software has no reaction with no errors
#94
adambnn
opened
1 year ago
0
use with Next.js (webpack fails to load binary file)
#93
eagor
opened
1 year ago
3
Can't run the example on MacOS M1 pro
#92
greenido
opened
1 year ago
0
Llama.cpp Typescript: Cannot find name 'LoadModel'
#91
synw
closed
1 year ago
0
Bumping from 0.1.5 to 0.1.6 resulting with `Error: invariant broken`
#90
NitayRabi
opened
1 year ago
0
chore: sync recent rwkv.cpp version
#88
yorkzero831
closed
1 year ago
7
update: refractor onnx
#87
hlhr202
closed
1 year ago
0
update: upgrade llm to 0.2.0-dev
#86
fardjad
closed
1 year ago
2
llama-node/llama-cpp uses more memory than standalone llama.cpp with the same parameters
#85
fardjad
opened
1 year ago
3
Ggml v3 support in Llama.cpp
#84
synw
closed
1 year ago
4
no kernel image is available for execution on the device
#83
determo13
opened
1 year ago
2
Error: Too many tokens predicted
#81
dhd5076
closed
1 year ago
1
Error: Missing field `nGpuLayers`
#80
bakiwebdev
opened
1 year ago
6
Failed to convert napi value into rust type `bool`
#79
determo13
closed
1 year ago
1
Segmentation fault local cuda build
#78
chrgeor
opened
1 year ago
0
Embeddings.js file does not work correctly
#77
skirodev
opened
1 year ago
0
foreign exception error
#76
ralyodio
opened
1 year ago
12
feature: optimiza llama.cpp loading, fix llama.cpp tokenizer, unify logger
#75
hlhr202
closed
1 year ago
0
app crashes when input is too long
#74
ralyodio
closed
1 year ago
6
[ERROR] cublas `TypeError: this.instance.inference is not a function`
#73
tchereau
opened
1 year ago
3
Illegal instruction (core dumped)
#72
itz-coffee
opened
1 year ago
4
getting error after second run
#71
ralyodio
closed
1 year ago
0
TypeError: llm._modelType is not a function
#70
gaurav-cointab
opened
1 year ago
1
Code only using 4 CPU, when I have 16 CPU
#69
gaurav-cointab
opened
1 year ago
3
Next