OpenRLHF/openrlhf/models/utils.py LlamaRotaryEmbedding is not compatible with transformers 4.38.1

OpenLLMAI / OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

https://openrlhf.readthedocs.io/

Apache License 2.0

1.73k stars 164 forks source link

Closed jiashenggu closed 4 months ago

jiashenggu commented 4 months ago

the calculation of cos, sin and input of forward is not compatible with transformers 4.38.1.