CASIA-LM / MoDS

111 stars 11 forks source link

How about using PEFT methods for fine-tuning? #1

Open beyondguo opened 9 months ago

beyondguo commented 9 months ago

Hi, congrats for your nice work. It seems that you are tuning the full parameters in this paper. How well does it work if I use techniques like LoRA for fine-tuning? Have you tried to experiment with that? Thanks!