Open lucasdegeorge opened 6 days ago
The issue has been solved with #2246 TRL 0.11.4 is not compatible with Transformers 4.46. We will release TRL 0.12 very soon
What is the working fix for this issue now? which library versions we can use now for temp solution? should be downgrade transformers
Yes, use the latest version of TRL and v4.45.2 of Transformers. This fixed it for me.
Yes, use the latest version of TRL and v4.45.2 of Transformers. This fixed it for me.
u mean the TRL 0.11.4?
yes
yes
Really thanks.. it worked for me..
System Info
System Info
Information
Tasks
examples
folderReproduction
Code to reproduce the error (with transformers==4.46.0 and trl==0.11.4)
This error is raised:
Expected behavior
It seems to be due to the recent commit 6ba31a8 on Oct 17, 2024 "Enable users to use their own loss functions + deal with prefetching for grad accum (https://github.com/huggingface/transformers/pull/34198)" on Transformers 4.46.0 where a new method get_batch_samples is defined and used by _inner_training_loop
But the subclass DPOTrainer overwrites the method get_batch_samples with a different signature (and output).
Error can be avoided with Transformers==4.45.2 and trl==0.11.4