search

facebookresearch / ParlAI

A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
https://parl.ai
MIT License
10.47k stars 2.09k forks source link

PEFT for BlenderBot #5081

Open Lkh97 opened 12 months ago

Lkh97 commented 12 months ago

Hi there. I have a question. Is PEFT supported for blenderBot, BlenderBot2, or BlenderBot3? I need to apply LoRA or QLoRA to Blenderbot. Your response or any advice on this issue is deeply appreciated.

mojtaba-komeili commented 11 months ago

No, we did not use PEFT in our work.