simonw llm-llama-cpp issues

simonw / llm-llama-cpp

LLM plugin for running models using llama.cpp

Apache License 2.0

136 stars 19 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

FreeBSD seems to get Unsupported Platform

#33 rabbitear opened 2 months ago
0
Error running with `-m gguf` option

#32 nickagliano-st closed 7 months ago
2
default n_gpu_layers to -1

#31 AviKav opened 7 months ago
0
context truncation for long chats

#30 tom-p-reichel opened 8 months ago
0
Fix gguf model registration with no models dir

#29 georgebashi opened 8 months ago
1
Add support for Hugging Face style chat templating

#28 simonw opened 8 months ago
4
ggud model type doesn't appear in llm models list until you've added a model with llama-cpp add-model

#27 wtfrank opened 8 months ago
2
Ability to run a GGML file without registering it

#26 simonw closed 8 months ago
1
[llm llama-cpp download-model] error shows[No such option: --alias]

#25 Davidcake opened 9 months ago
0
Typo in README - num_gpu_layers to n_gpu_layers 10

#24 curreta closed 8 months ago
1
Run Llama 2 on your own Mac using LLM and Homebrew - Issues Following Blog Post

#23 Olshansk opened 9 months ago
1
Outputs "ggml_metal_free: deallocating" to standard error

#22 simonw closed 8 months ago
3
Add plumming for additional model parameters.

#21 hhughes opened 11 months ago
2
Option to change max_tokens

#20 simonw closed 11 months ago
1
GPU offload layers greater than 1?

#19 LoopControl closed 11 months ago
3
Set max_tokens parameters to 4000

#18 almet closed 11 months ago
5
Support for logprobs

#17 simonw opened 11 months ago
2
Update llm_llama_cpp.py to support .gguf files. Update README. Closes #10.

#16 programmylife closed 11 months ago
1
llama.cpp model not staying in memory with llm chat

#15 m0nac0 opened 11 months ago
0
Fixing Metal, truncated answers and GGML errors (howto)

#14 vividfog opened 11 months ago
1
Server mode

#13 lun-4 closed 11 months ago
1
Indicate streaming support. Fixes #11

#12 michitux closed 11 months ago
1
Output does not stream

#11 bvanslyke closed 11 months ago
1
"Error:" after i try to start a chat

#10 vadykoo closed 11 months ago
18
Try Code Llama

#9 simonw opened 1 year ago
4
AttributeError: 'Llama' object has no attribute 'ctx'

#8 h4rk8s closed 1 year ago
3
Try out METAL and add to compilation instructions

#7 simonw closed 8 months ago
19
Responses are truncated too early

#6 simonw opened 1 year ago
4
Ship to PyPI

#5 simonw closed 1 year ago
0
Download model should use llm.user_path() and register once complete

#4 simonw closed 1 year ago
1
Document different installation options

#3 simonw closed 1 year ago
6
Add chat prompt support

#2 simonw closed 1 year ago
7
Initial plugin design

#1 simonw closed 1 year ago
3