search

18907305772 / FuseAI

FuseAI Project
https://huggingface.co/FuseAI
75 stars 33 forks source link

Comparison with merging LLaMA-2 CLM and LLaMA-2 #4

Open leegao opened 7 months ago

leegao commented 7 months ago

Within https://github.com/fanqiwan/FuseLLM/blob/main/assets/fig_4.png, it would be nice to be able to see a comparison of LLaMA-2, LLaMA-2 CLM, FuseLLM, and a merge using just LLaMA-2, LLaMA-2 CLM as well

18907305772 commented 6 months ago

Hello @leegao, thank you for your question! We have updated the merge version in the FuseChat project (https://arxiv.org/abs/2402.16107), you can see the merging results in our tech report.