search

SJTU-IPADS / PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
MIT License
7.96k stars 412 forks source link

是否考虑支持codellama #104

Open littlebai3618 opened 10 months ago

littlebai3618 commented 10 months ago

如题

hodlen commented 10 months ago

我们在积极考虑支持新的模型，但受限于数据和算力，我们近期只计划了Fine-tune Mistral 7B模型。请关注我们在 #93 中的进展。

We are actively considering the support of new models, but due to limitations in data and computing power, our current plans are limited to fine-tuning the Mistral 7B model. Please follow our latest progress in issue #93.