Limited models for fine-tuning

Alpha-VLLM / LLaMA2-Accessory

An Open-source Toolkit for LLM Development

https://llama2-accessory.readthedocs.io/

Other

2.68k stars 169 forks source link

Limited models for fine-tuning #12

Closed kb-open closed 11 months ago

kb-open commented 1 year ago

Support for models for fine-tuning seems to be very limited. Is LLaMA-2 fine-tuning supported? Will MPT / Falcon fine-tuning be supported?

gaopengpjlab commented 1 year ago

This repo is mainly designed for finetuning LLaMa2 upon various datasets. What do you mean by "Is LLaMA-2 fine-tuning supported?" ? Currently, we mainly support LLaMa2 finetuning. No plans for MPT / Falcon finetuning.