Llama3 support - Githubissues

Leeroo-AI / mergoo

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

https://www.leeroo.com/

GNU Lesser General Public License v3.0

397 stars 25 forks source link

Closed alirezamshi closed 5 months ago

alirezamshi commented 5 months ago

Added LLaMa3 support
Added Tutorial for building MoE-style LLMs by integrating domain-based LLaMa3-based models

gitsailor5 commented 5 months ago

looks good!