search

cckuailong / SuperAdapters

Finetune ALL LLMs with ALL Adapeters on ALL Platforms!
Apache License 2.0
282 stars 21 forks source link

sample finetune Gemma #8

Open droid2015 opened 3 months ago

droid2015 commented 3 months ago

You can add parameter for Gemma

cckuailong commented 3 months ago

You can use "--model_type gemma" to finetune with Gemma.

Example:

python finetune.py --model_type gemma --data "data/train/" --model_path "LLMs/gemma/gemma/" --adapter "lora" --output_dir "output/gemma"
python inference.py --model_type gemma --instruction "Who are you?" --model_path "LLMs/gemma/gemma/" --adapter_weights "output/gemma" --max_new_tokens 32