BreakoutNoFrameskip-v4 in ppo2 does not match

araffin / rl-baselines-zoo

A collection of 100+ pre-trained RL agents using Stable Baselines, training and hyperparameter optimization included.

https://stable-baselines.readthedocs.io/

MIT License

1.12k stars 208 forks source link

BreakoutNoFrameskip-v4 in ppo2 does not match #44

Closed xinghua-qu closed 4 years ago

xinghua-qu commented 4 years ago

When I try to load the pkl file from ppo2 folder (under trained_agents), I got this error: TypeError: Expected float32 passed to parameter 'value' of op 'Assign', got 'model/c1/w:0' of type 'str' instead.

After checking the folder, I found that the description for BreakoutNoFrameskip-v4.pkl is td3. I think there may exist some mistakes.

araffin commented 4 years ago

Hello,

Please fill in the issue template.

the following command runs perfectly fine:

 python enjoy.py --algo ppo2 --env BreakoutNoFrameskip-v4