search

AIoT-MLSys-Lab / Efficient-LLMs-Survey

[TMLR 2024] Efficient Large Language Models: A Survey
https://arxiv.org/abs/2312.03863
970 stars 82 forks source link

Add MiniMA for white-box KD #1

Closed GeneZC closed 9 months ago

GeneZC commented 9 months ago

Please kindly consider MiniMA as a representative in white-box KD.

https://huggingface.co/GeneZC/MiniMA-3B

BTW, Mamba is recently also a popular item in state space models.

https://huggingface.co/state-spaces/mamba-2.8b

tuidan commented 9 months ago

Thank you! We have added them.