search

LyWangPX / Reinforcement-Learning-2nd-Edition-by-Sutton-Exercise-Solutions

Solutions of Reinforcement Learning, An Introduction
MIT License
2.02k stars 466 forks source link

Exercise 4.8 #69

Closed LevinCeglie closed 4 years ago

LevinCeglie commented 4 years ago

In the first part of your answer you said that there would be a 0.5 probability of winning if our capital is at 50. That is not true, we actually have a 0.4 probability of winning, because the given problem defines the probability of the coin coming up heads as ph = 0.4. You can also see it in the Graph above. It's only a minor detail, but I still wanted to point it out in case somebody is confused by it.

LyWangPX commented 4 years ago

Thanks for pointing it out. You are right. Let me correct it in a minute.