search

locuslab / wanda

A simple and effective LLM pruning approach.
https://arxiv.org/abs/2306.11695
MIT License
626 stars 81 forks source link

Falcon 7b / 40b #13

Open BaiqingL opened 1 year ago

BaiqingL commented 1 year ago

Since llama isn't fully open source, are there current support or plans to also prune Falcon? Here is the huggingface link https://huggingface.co/tiiuae/falcon-7b

Eric-mingjie commented 1 year ago

Hi. Thanks for your interest in our work.

There is no current ongoing effort to prune Falcon. We may look into it in the future. Given the simplicity of Wanda, we think it should be easily implemented for other Transformer based LLMs.