issues
search
mzbac
/
AutoGPTQ-API
Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
91
stars
14
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Requirements and Speed
#7
LoggeL
opened
11 months ago
1
Can not load local model with Auto-GPTQ
#6
bonuschild
opened
1 year ago
2
How add an API if the model is already downloaded separately via text-generation-webui
#5
vishagar81
opened
1 year ago
2
cpu not supported
#4
mcanerim
closed
1 year ago
1
How to do this w ngrok?
#3
ashercn97
opened
1 year ago
0
Usage in streaming api
#2
tridungduong16
opened
1 year ago
0
Run on Google Colab
#1
apcameron
closed
1 year ago
5