jxiw / MambaInLlama

Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
https://arxiv.org/abs/2408.15237
Apache License 2.0
164 stars 12 forks source link

Some notes on improving HF integration #4

Closed NielsRogge closed 2 months ago

NielsRogge commented 2 months ago

Hi,

Niels here from the open-source team at Hugging Face. I discovered your work through the paper page: https://huggingface.co/papers/2408.15237.

Thanks for making the models available on the 🤗 hub. Some small suggestions on how to improve the discoverability of your work:

Let me know if you need any help regarding this!

Cheers,

Niels ML Engineer @ HF 🤗

jxiw commented 2 months ago

Hey Niels,

Thank you for those great suggestions! We did those.

Cheers, Junxiong

NielsRogge commented 2 months ago

Awesome, thanks a lot!