Open BrownTan opened 2 weeks ago
Can you tell me how to prune from llama 3.1 8B and get llama 3.2 1B/3B? I am very interested in such a high pruning rate and would appreciate it if you could provide more details.
Our blog https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/ has details. Do those work for you?
Can you tell me how to prune from llama 3.1 8B and get llama 3.2 1B/3B? I am very interested in such a high pruning rate and would appreciate it if you could provide more details.