search

18907305772 / FuseAI

FuseAI Project
https://huggingface.co/FuseAI
76 stars 34 forks source link

Comparison with merging LLaMA-2 CLM and LLaMA-2 #4

Open leegao opened 10 months ago

leegao commented 10 months ago

Within https://github.com/fanqiwan/FuseLLM/blob/main/assets/fig_4.png, it would be nice to be able to see a comparison of LLaMA-2, LLaMA-2 CLM, FuseLLM, and a merge using just LLaMA-2, LLaMA-2 CLM as well

18907305772 commented 8 months ago

Hello @leegao, thank you for your question! We have updated the merge version in the FuseChat project (https://arxiv.org/abs/2402.16107), you can see the merging results in our tech report.