search

allenai / RL4LMs

A modular RL library to fine-tune language models to human preferences
https://rl4lms.apps.allenai.org/
Apache License 2.0
2.13k stars 191 forks source link

Just a warning that the package doesn't work with Transformers 4.25.1 #22

Open JulesGM opened 1 year ago

JulesGM commented 1 year ago

Looks like generation_beam_constraints doesn't exist or has been moved?

Screen Shot 2022-12-16 at 4 25 29 PM
rajcscw commented 1 year ago

yeah true, if we are to upgrade transformers, we need to update hf_generation_utils.py too.