GraphPKU / PiSSA

PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)
https://arxiv.org/abs/2404.02948
261 stars 9 forks source link

Cannot reproduce results on GLUE #24

Open qinghaojun opened 2 weeks ago

qinghaojun commented 2 weeks ago

I cannot reproduce your results on GLUE dataset using roberta-large,the results on my machine are pretty lower than yours,could you provide offer relevant code?Thanks!