I fixed a few minor typos and broken links, for example
rllib.io (the documentation)
use of Bokeh looks great!
(I wish that GitHub rendering of saved images and linking/back-button wasn't so klunky)
I really like the structure of the exercises, such as needing to rework configurations. That's a valuable complement to what's hard to get from reading the docs.
Review up through
03-Application-Cart-Pole.ipynb
I fixed a few minor typos and broken links, for example
rllib.io (the documentation)