18907305772 / FuseAI

FuseAI Project
https://huggingface.co/FuseAI
75 stars 33 forks source link

Any plan to release the training code? #1

Closed VimukthiRandika1997 closed 7 months ago

VimukthiRandika1997 commented 7 months ago

I am really impressed with work, I would think how we can apply this to the other domains like computer vision.

Thank you!

18907305772 commented 7 months ago

FuseLLM only requires the extraction of the source model's representation of the training samples and then training the target model. Therefore, this approach can potentially be applied to other domains for knowledge fusion of multiple structurally diverse models as well.

We will release the code this week!

Thank you for your interest!

VimukthiRandika1997 commented 7 months ago

@18907305772 Thank you very much!