18907305772 / FuseAI

FuseAI Project
https://huggingface.co/FuseAI
76 stars 34 forks source link

Any plan to release the training code? #1

Closed VimukthiRandika1997 closed 10 months ago

VimukthiRandika1997 commented 10 months ago

I am really impressed with work, I would think how we can apply this to the other domains like computer vision.

Thank you!

18907305772 commented 10 months ago

FuseLLM only requires the extraction of the source model's representation of the training samples and then training the target model. Therefore, this approach can potentially be applied to other domains for knowledge fusion of multiple structurally diverse models as well.

We will release the code this week!

Thank you for your interest!

VimukthiRandika1997 commented 10 months ago

@18907305772 Thank you very much!