search

arcee-ai / mergekit

Tools for merging pretrained large language models.
GNU Lesser General Public License v3.0
4.69k stars 426 forks source link

Merge two models of different architectures #36

Open fakerybakery opened 10 months ago

fakerybakery commented 10 months ago

Hi, Is it possible to merge a Mistral and a Llama model? Also, would it be possible to convert a Mistral model to a model in the Llama format? Thank you!

BBC-Esq commented 2 months ago

Hi, Is it possible to merge a Mistral and a Llama model? Also, would it be possible to convert a Mistral model to a model in the Llama format? Thank you!

I found this here:

https://github.com/arcee-ai/mergekit/issues/60