search

arcee-ai / mergekit

Tools for merging pretrained large language models.
GNU Lesser General Public License v3.0
3.97k stars 344 forks source link

Merge Multimodal LLMs #219

Open TechxGenus opened 3 months ago

TechxGenus commented 3 months ago

Is it possible to merge multimodal LLMs? For example, could Llava and CodeLlama be merged? It might be beneficial for some software engineering tasks

prateeky2806 commented 2 months ago

https://arxiv.org/pdf/2304.14933.pdf