meta-llama / llama-models

Utilities intended for use with Llama models.
Other
4.47k stars 784 forks source link

How to prune? #155

Open BrownTan opened 2 weeks ago

BrownTan commented 2 weeks ago

Can you tell me how to prune from llama 3.1 8B and get llama 3.2 1B/3B? I am very interested in such a high pruning rate and would appreciate it if you could provide more details.

ashwinb commented 2 weeks ago

Our blog https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/ has details. Do those work for you?