QingruZhang AdaLoRA issues

QingruZhang / AdaLoRA

AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).

MIT License

230 stars 23 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

How to use other importance metrics as in Table 4 (section 4.4)?

#25 geoffvdr opened 1 month ago
0
where is the "training cost as C(P, E, Q)" in your total loss L(P, E, Q) = C(P, E, Q) + γ Pn k=1 R(Pk, Qk),

#24 LiZhangMing opened 2 months ago
0
Random seeds used in your experiments

#23 Car-pe opened 4 months ago
2
Question about orthogonal regularization methods

#22 fei407 opened 4 months ago
1
TypeError: unsupported operand type(s) for *: 'Parameter' and 'NoneType'

#21 tf2bb opened 5 months ago
3
AssertionError

#20 luoxindi opened 5 months ago
2
The question about convergence speed

#19 Lanbai-eleven opened 7 months ago
1
AssertionError: DistributedDataParallel is not needed when a module doesn't have any parameter that requires a gradient.

#18 DigitalLifeYZQiu opened 7 months ago
0
When I use multi-GPU training on a single machine, the following error is reported：ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 470401) of binary: /home/sqh/miniconda3/envs/NLU/bin/python

#17 Sun-9923 opened 7 months ago
1
Question about the random seeds

#16 SEONHOK opened 8 months ago
0
Does 'apply_rankselector appear in the code?

#15 dddfaker closed 3 months ago
1
Fusion lora weights to original weights

#14 vvhj opened 8 months ago
0
TypeError: 'NoneType' object is not iterable

#13 lcqlalala opened 8 months ago
10
Questions about ranknum

#12 luchaoqi closed 5 months ago
1
A mismatch between best hyperparameters and hyperparameters ranges

#11 kefirski opened 10 months ago
2
How about the variance in GLUE bencharmark?

#10 A11en0 opened 11 months ago
0
How do you find the optimal parameters?

#9 A11en0 opened 11 months ago
2
Lora Dreambooth?

#8 Dentoty closed 3 months ago
1
Tried to run ./scripts/run_debertav3_mnli.sh but received error ""

#7 ndvbd closed 11 months ago
3
How to implement prune LoRA?

#6 A11en0 closed 3 months ago
1
What is the exactly count of parameters in DeBERTaV3-base

#5 Lucius-lsr closed 11 months ago
1
TypeError: __init__() got an unexpected keyword argument 'rankallocator'

#4 fxb392 closed 1 year ago
6
question about early stopping

#3 DopamineLcy closed 1 year ago
2
from_pretrained parameters

#2 fxb392 closed 1 year ago
2
Request for Hyperparameters to Reproduce Full Fine-Tuning Results in GLUE

#1 HarryWu99 closed 1 year ago
1