issues
search
1b5d
/
llm-api
Run any Large Language Model behind a unified API
MIT License
159
stars
25
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
GH actions free up disk space
#18
1b5d
closed
11 months ago
0
Multiple BLAS backends support
#17
1b5d
closed
11 months ago
0
AWQ using AutoAWQ
#16
1b5d
closed
11 months ago
0
Illegal instruction (core dumped)
#15
dbzoo
opened
1 year ago
3
Update readme and bump dep version
#14
1b5d
closed
1 year ago
0
How to train model with my data - can i use api?
#13
michalbrzezinskiorg
closed
1 year ago
1
Release 0.1.0
#12
1b5d
closed
1 year ago
0
No module named 'torch'
#11
loversama
closed
1 year ago
4
Question and stop sequence are included in LLM response
#10
ernestp
closed
11 months ago
5
Example config file
#9
hussainwali74
closed
11 months ago
2
GPTQ Models with safetensors? - 'Missing key(s) in state_dict'
#8
JoshTickles
closed
11 months ago
2
I need a tutorial or real example.
#7
mateusgalasso
closed
1 year ago
2
Consider refactor for model types
#6
darth-veitcher
opened
1 year ago
0
CUDA enhancements and fixes
#5
darth-veitcher
closed
1 year ago
3
Can llm-api be used to run a model with GPU rather than CPU
#4
niparis
closed
11 months ago
7
Request: Lora support
#3
tensiondriven
opened
1 year ago
1
Is this quantized 7b ggml model too old?
#2
Jawabiscuit
closed
11 months ago
9
any advice for getting this running with `gpt-x-alpaca` models?
#1
darth-veitcher
opened
1 year ago
20