Add functions for pruning and retraining - Githubissues

Nota-NetsPresso / shortened-llm

Compressed LLMs for Efficient Text Generation [ICLR'24 Workshop]

63 stars 8 forks source link

Add functions for pruning and retraining #1

Closed bokyeong1015 closed 7 months ago

bokyeong1015 commented 7 months ago

Description

Add functions for pruning and retraining

Change(s)

Add source code for block pruning and lora-retraining
Add the results for block-level pruning criteria
Update docs