GraphPKU PiSSA issues - Githubissues

GraphPKU / PiSSA

PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)

https://arxiv.org/abs/2404.02948

261 stars 9 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

fast svd

#25 hhnqqq opened 2 days ago
2
Cannot reproduce results on GLUE

#24 qinghaojun opened 2 weeks ago
0
在加载时遇到cpu使用率过高的问题

#23 qinghaojun closed 2 weeks ago
0
Where is the evaluation code?

#22 Ther-nullptr opened 3 months ago
1
您好，PiSSA是否可以与LoRAMoE等方法进行结合，作为LoRA的初始化？LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugin

#21 Shubao-Zhao opened 3 months ago
0
使用llama-factory lora微调qwen1.5-32B-Chat，报错ValueError: Cannot initialize PiSSA adapter on quantized models.

#20 TC10127 closed 3 months ago
0
Why does my PiSSA init process so slow?

#19 ANYMS-A opened 4 months ago
2
Training scripts of Pissa with LLaMA-2-7b for 3 epoches

#18 lucasliunju closed 4 months ago
1
如何使用CodeFeedBack数据集进行微调的？

#17 Peroplex closed 4 months ago
1
关于kernel_size大于1的卷积的权重的分解

#16 lastapple closed 4 months ago
2
您好，是否可以支持CogVLM等多模态模型？

#15 Shubao-Zhao closed 4 months ago
2
It seems to be an error when getting_peft_model：ValueError: not enough values to unpack (expected 2, got 1)

#14 Pashisfisuta opened 4 months ago
1
Output singular value

#13 GYDTTDYX opened 4 months ago
0
Ask for help: I encountered the following error while running `gsm8k_inference.py`:

#12 cyp-jlu-ai closed 5 months ago
2
linalg.svd: The input tensor A must have at least 2 dimensions.

#11 q497629642 opened 5 months ago
3
Mismatches in tensor sizes

#10 poaboagye closed 5 months ago
4
fix preprocess.py

#9 xd2333 closed 5 months ago
1
[NLU] Testing PiSSA on the GLUE Benchmark with RoBERTa-Base Model?

#8 SKDDJ closed 5 months ago
1
memory issue

#7 Leosgp closed 6 months ago
3
A check on my Results

#6 poaboagye closed 6 months ago
2
Unable to unzip the MetaMathQA-395K.json.zip

#5 poaboagye closed 6 months ago
2
reproduce the results

#4 lucasliunju closed 6 months ago
2
what is difference between trrain.py and pissa_finetuning.py

#3 azuryl closed 6 months ago
1
High Training Loss

#2 andyzoujm closed 6 months ago
2
training数据集是否有问题？

#1 xinlanz closed 6 months ago
1