utiasDSL / safe-control-gym

PyBullet CartPole and Quadrotor environments—with CasADi symbolic a priori dynamics—for learning-based control and RL
https://www.dynsyslab.org/safe-robot-learning/
MIT License
636 stars 132 forks source link

Fixing minor issues causing CBF to fail #156

Closed Federico-PizarroBejarano closed 5 months ago

Federico-PizarroBejarano commented 5 months ago

In https://github.com/utiasDSL/safe-control-gym/issues/155 it was found the CBF tests were no longer working. I troubleshooted and found two issues: The recovery behaviour can't be normalized (which I fixed in base_experiment.sh) and the default PPO activation is tanh but was set to relu by https://github.com/utiasDSL/safe-control-gym/pull/151. Fixed both issues.