AIoT-MLSys-Lab / SVD-LLM

Official Code for "SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression"
https://arxiv.org/abs/2403.07378
Apache License 2.0
68 stars 6 forks source link

compresssed checkpoints #8

Closed aswanthkrishna closed 3 hours ago

aswanthkrishna commented 3 days ago

is it possible to obtain compressed checkpoints for llama2?

tuidan commented 2 days ago

is it possible to obtain compressed checkpoints for llama2?

Sure, we will open the checkpoints. Please stay tuned!