higgsfield / RL-Adventure

Pytorch Implementation of DQN / DDQN / Prioritized replay/ noisy networks/ distributional values/ Rainbow/ hierarchical RL
2.99k stars 587 forks source link

About Distributional DQN--projection_distribution #34

Open miilue opened 1 year ago

miilue commented 1 year ago

I am confused about Distributional DQN. Why 'next_dists' multiplied by support in the function of ’projection_distribution‘?My model got bad learning after using it. I would appreciate it if you could give me an answer in your spare time!

LRiver-wut commented 1 year ago

I am confused about the u. image