search

NVlabs / DoRA

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
https://arxiv.org/abs/2402.09353
Other
469 stars 23 forks source link

finetuning dir added #12

Open shirinyamani opened 3 weeks ago

shirinyamani commented 3 weeks ago

In this PR a dir named "dora finetuning" is added to the examples dir. The content of it includes a notebook teaching how to use Dora technique along with an script of fine-tuning using Dora. Hope this helps the community!