LyWangPX / Reinforcement-Learning-2nd-Edition-by-Sutton-Exercise-Solutions

Solutions of Reinforcement Learning, An Introduction
MIT License
2.02k stars 466 forks source link

Exercise 5.3 #59

Closed NishanthARao closed 4 years ago

NishanthARao commented 4 years ago

Could you please provide the backup diagram for exercise 5.3 i.e., the backup diagram for Q\pi ? I wanted to check if it's right, and I could find it nowhere else.

Like could you draw it on a paper and attach the scanned image in chapter 5 folder?

Thank you so much.

LyWangPX commented 4 years ago

It would be super long straight line until you hit the end. Please refer to Figure 7.3 on page 146.