search

openai / baselines

OpenAI Baselines: high-quality implementations of reinforcement learning algorithms
MIT License
15.69k stars 4.86k forks source link

cliprange_vf is missing #1141

Open shtse8 opened 4 years ago

shtse8 commented 4 years ago

https://stable-baselines.readthedocs.io/en/master/modules/ppo2.html#stable_baselines.ppo2.PPO2

there is a cliprange_vf param in the docuementation.

but I can't find it in code. https://github.com/openai/baselines/blob/master/baselines/ppo2/ppo2.py#L21

also, the clipping code is using the same cliprange param as the ratio using. https://github.com/openai/baselines/blob/master/baselines/ppo2/model.py#L69

DanielTakeshi commented 4 years ago

@shtse8 baselines is no longer maintained. I recommend stable-baselines. https://github.com/hill-a/stable-baselines