google-deepmind / rlax

https://rlax.readthedocs.io
Apache License 2.0
1.24k stars 85 forks source link

Fix/dqn example #121

Open KaleabTessera opened 1 year ago

KaleabTessera commented 1 year ago

This PR includes two fixes for the dqn example:

  1. Fix import error:

    Traceback (most recent call last):
      File "examples/simple_dqn.py", line 28, in <module>
        from rlax.examples import experiment
    ModuleNotFoundError: No module named 'rlax.examples'

    There is already a PR for this, but this fixes the whole dqn example.

  2. Fix epsilon scheduling (https://github.com/deepmind/rlax/issues/102).

    These lines (1 , 2) reset the actor steps, which results in the wrong counts being passed to the eps scheduling function here. This outcome of this is a cyclic eps schedule which is not intended.