search

higgsfield / RL-Adventure

Pytorch Implementation of DQN / DDQN / Prioritized replay/ noisy networks/ distributional values/ Rainbow/ hierarchical RL
2.99k stars 587 forks source link

batch_size for DQN #28

Open narrowsnap opened 4 years ago

narrowsnap commented 4 years ago

Thanks for your codes which work very well. The origin DQN(1.dqn.ipynb) set batch_size=32 which is ineffective on GUP so I changed it to 256. But it's bad performance. Is there any experience in this?

batch_size=32

Screen Shot 2019-10-24 at 10 13 44 AM

batch_size=256

Screen Shot 2019-10-24 at 10 04 52 AM

Or should I try more experiments with batch_size=256 or try more random seed? Thanks again.