search

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
18.37k stars 1.28k forks source link

Can you support the fine-tuning of the MiniCPM3-4B model ? #1277

Open faceair opened 1 week ago

faceair commented 1 week ago

https://huggingface.co/openbmb/MiniCPM3-4B

MiniCPM3-4B performs well under the same model, but I couldn't find this model under the unsloth organization on https://huggingface.co/unsloth.

Now can unsloth support the fine-tuning of this model ?

danielhanchen commented 1 week ago

Currently not, but vision support should be coming soon!

faceair commented 1 week ago

Is the MiniCPM-V the same structure as MINICPM3-4B? Is it easy to support them together?

shimmyshimmer commented 6 hours ago

Hey apologies for the delays. Vision models are now supported in Unsloth! Please update Unsloth :)

Read our blogpost: https://unsloth.ai/blog/vision Tweet: https://x.com/UnslothAI/status/1859667930075758793 GitHub post: https://github.com/unslothai/unsloth/releases/tag/November-2024 Vision Model uploads: https://huggingface.co/collections/unsloth/vision-multimodal-models-673eb9908fc2cb3deebd2fa3