search

allenai / RL4LMs

A modular RL library to fine-tune language models to human preferences
https://rl4lms.apps.allenai.org/
Apache License 2.0
2.2k stars 192 forks source link

BART supervised #10

Open talent404 opened 1 year ago

talent404 commented 1 year ago

I have tried using BART as a seq2seq type model, from huggingface facebook/bart-large. This howerver throws an error saying that .parallelise doesnt exit. Has anyone been able to finetune bart using this repo?

rajcscw commented 1 year ago

@talent404 This is a known issue. We have a PR coming up to fallback to data parallel when model parallel is not available. I will keep you posted.

keeganstoner commented 1 year ago

Is the error message AttributeError: 'BartForConditionalGeneration' object has no attribute 'encoder' related to this? That's what I get when trying to finetune bart.