RL Course 1 Week 4 blog

[sezan92]

Update 2024/01/31

• [x] Started W4 L1
• [x] Completed video

TODO

• [x] Start writeup

[sezan92]

Update 2024/02/08

• 37

• [x] upto 1:27

TODO

• [ ] write the other details

[sezan92]

Update 2024/02/17

• [x] upto 1:57

[sezan92]

Update 2024/03/07

• [x] upto C1W4L3 v1 3:24

TODO

• [ ] understand strictly better policyt
• [x] complete the video

[sezan92]

Update 2024/03/16

• [x] C1W4L3 done

TODO

• [ ] complete C1W4L4

[sezan92]

Update 2024/04/16

• [ ]. Unable to intuition for iterative policy evaluatio n network
• [x] need to re thinking.

[sezan92]

2024/04/19

• [x] intuition started https://github.com/sezan92/sezan92.github.io/pull/37/commits/9ba63eabadf6a199d204509549e9500697f97ab7

TODO

• [x] complete the intuition with the diagrams

[sezan92]

Update 2024/04/30

• [x] made some diagrams.

i have some problems with the diagrams, the diagram does not follow proper bellman equation with probability.

TODO

• [ ] make the diagram with the bellman equation, with proper probability https://excalidraw.com/

[sezan92]

Update 2024/05/16

• [x] Updated pictures

TODO

• [x] Write down intuition

[sezan92]

Update 2024/05/29

• [x] wrote intuition

TODO

• [x] start https://www.coursera.org/learn/fundamentals-of-reinforcement-learning/lecture/ICAfp/iterative-policy-evaluation

[sezan92]

Update 2024/06/04

• [x] watched video https://www.coursera.org/learn/fundamentals-of-reinforcement-learning/lecture/FVd6r/policy-improvement
• [x] watched videos https://www.coursera.org/learn/fundamentals-of-reinforcement-learning/lecture/Xv32P/policy-iteration

TODO

• [x] writeup on the above videos

[sezan92]

Update 2024/06/14

• [x] writeup done on the policy improvement and iteration videos

TODO

• [x] start watching https://www.coursera.org/learn/fundamentals-of-reinforcement-learning/lecture/tusGq/flexibility-of-the-policy-iteration-framework
• [ ] writeup on this

[sezan92]

Update 2024/06/19

• [x] watched tart watching https://www.coursera.org/learn/fundamentals-of-reinforcement-learning/lecture/tusGq/flexibility-of-the-policy-iteration-framework
• [x] and https://www.coursera.org/learn/fundamentals-of-reinforcement-learning/lecture/ANQkM/efficiency-of-dynamic-programming

TODO

• [ ] Writeup on this.

[sezan92]

Update 2024/06/23

• [x] I have checked the Generalized Policy iteration video, got the difference with the Policy Iteration framework. need to have a good writeup

TODO

• [x] make the difference intuitive

[sezan92]

Update 2024/06/26

• [x] Wrote about General Policy Iteration. or value iteration

TODO

• [x] Explain Dynamic Programming and how it is useful

[sezan92]

Completed in #37