openai / mujoco-py

MuJoCo is a physics engine for detailed, efficient rigid body simulations with contacts. mujoco-py allows using MuJoCo from Python 3.
Other
2.83k stars 810 forks source link

Fix gym rewards by automatically evaluating cfrc_ext #659

Open krzentner opened 2 years ago

krzentner commented 2 years ago

This change should prevent openai/gym from producing incorrect results when mujoco 2 is used (which many people are doing in practice).

This PR replaces PR #594 (also by me) but is from my fork (instead of @AlexanderGri's fork), so that I can rebase it for the CI.