How to merge a VLM and LLM with different model type.

arcee-ai / mergekit

Tools for merging pretrained large language models.

GNU Lesser General Public License v3.0

4.57k stars 406 forks source link

How to merge a VLM and LLM with different model type. #319

Open tanyakansal30 opened 4 months ago

tanyakansal30 commented 4 months ago

I was trying to merge a VLM with an LLM in an evolutionary manner but this is what i getting, I encountered this error because of model types. Does anyone have a solution? Screenshot from 2024-05-10 17-48-09