search

horseee / LLaMA-Pruning

Structural Pruning for LLaMA
GNU General Public License v3.0
54 stars 4 forks source link

Benchmark for LLaMA pruning #2

Open dercaft opened 1 year ago

dercaft commented 1 year ago

If it is possible to give a benchmark of Pruned LLaMA.

horseee commented 1 year ago

Hi.

It's on our waitlist, but it requires a large amount of time and resources to conduct post-training on the pruned model. Otherwise, the pruned model is poorly functioning.

We are still trying to find a possible and efficient solution for post-training the pruned model since the dataset is not public. If you have any ideas, we would be grateful for any suggestions or contributions you may have.

horseee commented 1 year ago

We have updated the evaluation results in https://github.com/horseee/LLM-Pruner. Please refer to the new repo-v-