search

dgriff777 / rl_a3c_pytorch

A3C LSTM Atari with Pytorch plus A3G design
Apache License 2.0
563 stars 119 forks source link

Why ensure_shared_grads #25

Closed yiwan-rl closed 6 years ago

yiwan-rl commented 6 years ago

in you ensure_shared_grads function:

 if shared_param.grad is not None and not gpu:
            return

Can you explain what this means?

dgriff777 commented 6 years ago

Hey sorry for late reply. Been extremely busy with work. This for cpu only training after state initialization goes fine in beginning just return as params are updated fine.