search

mwhittaker / deeprl_project

Deep RL Final Project
1 stars 1 forks source link

create FrameStack option for `gen_pong_*` methods #21

Open vlad17 opened 7 years ago

vlad17 commented 7 years ago

Currently we have both wrap_train and gen_pong_env which have similar but not well-delineated roles. It'd probably be better to add a frame_stack= option to the gen_pong* methods, which would get propogated down to frame_stack= option in wrap_deepmind or wrap_deepmind_ram, which would then make an appropriate FrameStack call. In the case of RAM, since FrameStack requires 2d input, you might have to add a wrapper that makes the RAM 2D, then apply framestack, then add a wrapper that converts back to 1d

mwhittaker commented 7 years ago

Only need to frame stack RAM if unstacked RAM is bad.

SamvitJ commented 7 years ago

Only do this if RAM run from #3 sucks Deliverable: learning curve for stacked RAM