How to use other importance metrics as in Table 4 (section 4.4)?

QingruZhang / AdaLoRA

AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).

MIT License

259 stars 28 forks source link

Open geoffvdr opened 4 months ago

geoffvdr commented 4 months ago

Hello,

Is the code available (which parameters?) for using other importance metrics (e.g. absolute value of singular value) as in Table 4 of Section 4.4?

Thank you.