exllamav2 hf auto split gpu - Githubissues

TigerResearch / TigerBot

TigerBot: A multi-language multi-task LLM

https://www.tigerbot.com

Apache License 2.0

2.24k stars 194 forks source link

exllamav2 hf auto split gpu #145

Closed wangyu1997 closed 11 months ago