search

dgriff777 / rl_a3c_pytorch

A3C LSTM Atari with Pytorch plus A3G design
Apache License 2.0
562 stars 119 forks source link

Is the max pool and activation in the right order? #3

Closed ethancaballero closed 7 years ago

ethancaballero commented 7 years ago

Usually max_pool2d is applied after each (relu) activation, but you apply max_pool2d before each activation. Did you try both ways and one worked better?

dgriff777 commented 7 years ago

with max-pooling layer and ReLU the order does not matter. Both calculate to same thing. but relu(max_pool2d(conv2(x)) does it significantly faster by doing less number of operations