How to perform a fine-tuning with QLoRA?

cckuailong / SuperAdapters

Finetune ALL LLMs with ALL Adapeters on ALL Platforms!

Apache License 2.0

283 stars 21 forks source link

How to perform a fine-tuning with QLoRA? #5

Closed RuohuaTang closed 9 months ago

RuohuaTang commented 9 months ago

Hi there,

I can not find the argument about QLoRA, given that SuperAdapters supports it. I can only find adalora in the documentation. Can you please show me the code on fine-tuning with QLoRA?

Thanks in advance.