issues
search
simonw
/
llm-llama-cpp
LLM plugin for running models using llama.cpp
Apache License 2.0
136
stars
19
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
FreeBSD seems to get Unsupported Platform
#33
rabbitear
opened
2 months ago
0
Error running with `-m gguf` option
#32
nickagliano-st
closed
7 months ago
2
default n_gpu_layers to -1
#31
AviKav
opened
7 months ago
0
context truncation for long chats
#30
tom-p-reichel
opened
8 months ago
0
Fix gguf model registration with no models dir
#29
georgebashi
opened
8 months ago
1
Add support for Hugging Face style chat templating
#28
simonw
opened
8 months ago
4
ggud model type doesn't appear in llm models list until you've added a model with llama-cpp add-model
#27
wtfrank
opened
8 months ago
2
Ability to run a GGML file without registering it
#26
simonw
closed
8 months ago
1
[llm llama-cpp download-model] error shows[No such option: --alias]
#25
Davidcake
opened
9 months ago
0
Typo in README - num_gpu_layers to n_gpu_layers 10
#24
curreta
closed
8 months ago
1
Run Llama 2 on your own Mac using LLM and Homebrew - Issues Following Blog Post
#23
Olshansk
opened
9 months ago
1
Outputs "ggml_metal_free: deallocating" to standard error
#22
simonw
closed
8 months ago
3
Add plumming for additional model parameters.
#21
hhughes
opened
11 months ago
2
Option to change max_tokens
#20
simonw
closed
11 months ago
1
GPU offload layers greater than 1?
#19
LoopControl
closed
11 months ago
3
Set max_tokens parameters to 4000
#18
almet
closed
11 months ago
5
Support for logprobs
#17
simonw
opened
11 months ago
2
Update llm_llama_cpp.py to support .gguf files. Update README. Closes #10.
#16
programmylife
closed
11 months ago
1
llama.cpp model not staying in memory with llm chat
#15
m0nac0
opened
11 months ago
0
Fixing Metal, truncated answers and GGML errors (howto)
#14
vividfog
opened
11 months ago
1
Server mode
#13
lun-4
closed
11 months ago
1
Indicate streaming support. Fixes #11
#12
michitux
closed
11 months ago
1
Output does not stream
#11
bvanslyke
closed
11 months ago
1
"Error:" after i try to start a chat
#10
vadykoo
closed
11 months ago
18
Try Code Llama
#9
simonw
opened
1 year ago
4
AttributeError: 'Llama' object has no attribute 'ctx'
#8
h4rk8s
closed
1 year ago
3
Try out METAL and add to compilation instructions
#7
simonw
closed
8 months ago
19
Responses are truncated too early
#6
simonw
opened
1 year ago
4
Ship to PyPI
#5
simonw
closed
1 year ago
0
Download model should use llm.user_path() and register once complete
#4
simonw
closed
1 year ago
1
Document different installation options
#3
simonw
closed
1 year ago
6
Add chat prompt support
#2
simonw
closed
1 year ago
7
Initial plugin design
#1
simonw
closed
1 year ago
3