OpenLLMAI / OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)
https://openrlhf.readthedocs.io/
Apache License 2.0
1.73k stars 164 forks source link

Fix yi-34b tokenizer, use_fast=False #241

Closed hijkzzz closed 3 months ago

hijkzzz commented 3 months ago

see https://github.com/OpenLLMAI/OpenRLHF/issues/240