TigerResearch / TigerBot

TigerBot: A multi-language multi-task LLM
https://www.tigerbot.com
Apache License 2.0
2.24k stars 194 forks source link

请问使用GPTQ量化后的模型是否支持训练或者微调? #58

Closed verigle closed 1 year ago

chentigerye commented 1 year ago

int4的train不主流不推荐,如果要加速,后续参考我们发布的lora吧

Smilefish1 commented 1 year ago

int4的train不主流不推荐,如果要加速,后续参考我们发布的lora吧

啥时候发布 啊,有详细的计划吗

chentigerye commented 1 year ago

qlora with tigerbot代码已发布。