Closed kkjh0723 closed 6 years ago
Indeed, I was doing something wrong by using the probabilities of action given 'old' models. I corrected this error into my PPO implementation, and now it seems to learn in all environments. I'm going to update everything.
Thank for the sharing the code. I tested that the code is working in the invertedPendulum-v1.
But when I changed the environment to Ant-v1 without changing any other parameters, it seems the agent failed to learn as below. Do I need to change some parameters?