search

princeton-nlp / LLM-Shearing

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
https://arxiv.org/abs/2310.06694
MIT License
539 stars 41 forks source link

Any updates on the code? #2

Closed AlpinDale closed 10 months ago

AlpinDale commented 10 months ago

Would love to experiment with LLM shearing, is the progress on finalizing the code still ongoing?

xiamengzhou commented 10 months ago

Sorry for the delay! We will make sure to publicize it by the end of this week.

winglian commented 10 months ago

Is this dropping today? 🙏

Coriana commented 10 months ago

Commenting here for when this drops so I can go all Mistral on its ...

yehuitang commented 10 months ago

Hello! Thanks for your wonderful work! Has the code been released?

xiamengzhou commented 10 months ago

Hi! We just released the codebase :) Thanks for your interest in the work!