search

Kaixhin / Rainbow

Rainbow: Combining Improvements in Deep Reinforcement Learning
MIT License
1.59k stars 284 forks source link

Building the environment with DeepMind wrappers #53

Closed bmazoure closed 5 years ago

bmazoure commented 5 years ago

The environment in this repo is implemented directly from atari_py. However, in some cases, it might be useful to have the option to build it using OpenAI Gym's syntax. Is there a direct equivalent of the current environment in terms of OpenAi baselines.common.atari_wrapper? I was thinking something along the lines of wrap_deepmind(gym.make('QbertNoFrameskip-v4'),episode_life=False,frame_stack=True,scale=True,clip_rewards=False), but this doesn't seem to achieve quite the same rewards as your implementation.

Kaixhin commented 5 years ago

I remember looking at baselines a long time ago and for whatever reason thinking it didn't quite work out, so maybe, but not sure. Should be possible to work out if you go through both codebases carefully. Would not introduce baselines as a dependency for this project though because it brings in a lot of unnecessary things.