Typo in Section on Derived Stochastic Processes

[rabarza]

Hello,

I hope this message finds you well. I wanted to bring to your attention a small typo in the section 1.2.3 concerning Derived Stochastic Processes, specifically on page 12, paragraph 3. It appears that "s^3" has been written instead of "h^3". I've highlighted the error in blue in the attached image for your reference.

Best regards,

Rolando Abarza

[martyput]

Thank you so much, I'll take a look. Marty Martin L. Puterman Professor Emeritus Sauder School of Business University of British Columbia @. Rolando Ignacio Jesús Abarza Cancino wrote: [CAUTION: Non-UBC Email] Hello, I hope this message finds you well. I wanted to bring to your attention a small typo in the section 1.2.3 concerning Derived Stochastic Processes, specifically on page 12, paragraph 3. It appears that "s^3" has been written instead of "h^3". I've highlighted the error in blue in the attached image for your reference. Captura.de.pantalla_16-4-202419566.jpeg (view on web) https://github.com/martyput/MDP_book/assets/73083196/7e1f35cf-af55-4a7a-a492-b5445c659c88 Best regards, Rolando Abarza — Reply to this email directly, view it on GitHub https://github.com/martyput/MDP_book/issues/2 , or unsubscribe https://github.com/notifications/unsubscribe-auth/A3P3T3RHRWD6SDHP6ZOTVODY5W3JNAVCNFSM6AAAAABGKIQIXOVHI2DSMVQWIX3LMV43ASLTON2WKOZSGI2DOMBVGM3TCOI . You are receiving this because you are subscribed to this thread.Message ID: @.>

[martyput]

Hi Rolando: Thank you for your careful reading. I checked p.12 and want to let you know that this is NOT a typo. For a history dependent policy all decision rules after the first depend on the entire history of the process. Hence that for different histories actions could be chosen with different probabilities as in the discussion on p.32. This is a subtle point not emphasized in the rl literature. We will add some emphasis in the text to clarify this. Martin L. Puterman Professor Emeritus Sauder School of Business University of British Columbia @. Rolando Ignacio Jesús Abarza Cancino wrote: [CAUTION: Non-UBC Email] Hello, I hope this message finds you well. I wanted to bring to your attention a small typo in the section 1.2.3 concerning Derived Stochastic Processes, specifically on page 12, paragraph 3. It appears that "s^3" has been written instead of "h^3". I've highlighted the error in blue in the attached image for your reference. Captura.de.pantalla_16-4-202419566.jpeg (view on web) https://github.com/martyput/MDP_book/assets/73083196/7e1f35cf-af55-4a7a-a492-b5445c659c88 Best regards, Rolando Abarza — Reply to this email directly, view it on GitHub https://github.com/martyput/MDP_book/issues/2 , or unsubscribe https://github.com/notifications/unsubscribe-auth/A3P3T3RHRWD6SDHP6ZOTVODY5W3JNAVCNFSM6AAAAABGKIQIXOVHI2DSMVQWIX3LMV43ASLTON2WKOZSGI2DOMBVGM3TCOI . You are receiving this because you are subscribed to this thread.Message ID: @.>