How to merge model from checkpoint. - Githubissues

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

https://unsloth.ai

Apache License 2.0

17.04k stars 1.17k forks source link

How to merge model from checkpoint. #486

Open mercuryyy opened 5 months ago

mercuryyy commented 5 months ago

How can we merge a checkpoint using:

model.push_to_hub_merged("xxxxx", tokenizer, save_method = "merged_16bit")

I tried reloading the original model using the lora path of the checkpoint and then running merging but it did not work.

danielhanchen commented 5 months ago

Will take a look! Sorry on the issue!