GraphPKU / PiSSA

PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)
https://arxiv.org/abs/2404.02948
261 stars 9 forks source link

使用llama-factory lora微调qwen1.5-32B-Chat,报错ValueError: Cannot initialize PiSSA adapter on quantized models. #20

Closed TC10127 closed 3 months ago

TC10127 commented 3 months ago

现在还不支持量化模型使用pissa嘛,