search

chenhunghan / ialacol

🪶 Lightweight OpenAI drop-in replacement for Kubernetes
MIT License
143 stars 17 forks source link

Add experimental support for GPTQ models #50

Closed chenhunghan closed 1 year ago

chenhunghan commented 1 year ago

Closes https://github.com/chenhunghan/ialacol/issues/47