Closed coldplayers closed 12 months ago
Hi, I have a question about the sparsity of the weight: After merge lora into sparse weight will change sparse weight into dense?
Hi @coldplayers, LLM-pruner is a structural method. After pruning, we get a dense model.
@VainF Thanks.
Hi, I have a question about the sparsity of the weight: After merge lora into sparse weight will change sparse weight into dense?