search

wgrathwohl / BackpropThroughTheVoidRL

RL Experiments from our paper "Backpropagation Through the Void": https://arxiv.org/abs/1711.00123. Lovingly forked from OpenAI's RL Baseline repo.
MIT License
38 stars 11 forks source link

Hello run_atari.py in a2c doesn #1

Open sungikchoi opened 6 years ago

sungikchoi commented 6 years ago

Hello, I'm interested in your work.

However, I got some issues in here. It seems to be the problem of using Cartpole environment in the atari wrapper but I cannot find how to solve it without changing the code too much.

Here is the full trace of the error

default

choidami commented 6 years ago

Hello, thanks for trying out our code! instead of " return wrap_deepmind(env)" in line 21 of run_atari.py can you try "return MaxAndSkipEnv(env)" and change the import statement to: "from baselines.common.atari_wrappers import wrap_deepmind, MaxAndSkipEnv"