awjuliani / DeepRL-Agents

A set of Deep Reinforcement Learning Agents implemented in Tensorflow.
MIT License
2.24k stars 826 forks source link

A3C-Doom w MultiRNNCell? #50

Open lefnire opened 7 years ago

lefnire commented 7 years ago

Wondering if anyone's had success implementing a deep RNN in AC_Network()? At first glance it looks as easy as

cell = tf.nn.rnn_cell.LSTMCell(256, state_is_tuple=True)
cell = tf.nn.rnn_cell.MultiRNNCell([cell] * 2, state_is_tuple=True)
# same stuff as before

but the output is now a tuple of tuples, which will change handling of c_in & h_in placeholders and feed_dicts throughout Worker(). Definitely a support request rather than bug, just I've tried my hand at this for a couple days & my newbiness is blocking me.