search

hkproj / rlhf-ppo

Notes and commented code for RLHF (PPO)
31 stars 15 forks source link

readme

Reinforcement Learning from Human Feedback

Notes and commented code for RLHF (PPO)

The code has been commented by using the trl library from Hugging Face with version 0.7.10: https://github.com/huggingface/trl/

You will find the original code of the ppo_trainer.py file and also the commented code. You can use any diff tool to check my comments.