search

google-deepmind / rlax

https://rlax.readthedocs.io
Apache License 2.0
1.24k stars 85 forks source link

Examples `online_q_learning` not working #136

Open marcdelabarrera opened 2 months ago

marcdelabarrera commented 2 months ago

I' trying to run https://github.com/google-deepmind/rlax/blob/master/examples/online_q_learning.py, but bsuit is not working. I get an AttributeError when trying to run 

 agent = OnlineQ(
      observation_spec=env.observation_spec(),
      action_spec=env.action_spec(),
      num_hidden_units=FLAGS.num_hidden_units,
      epsilon=FLAGS.epsilon,
      learning_rate=FLAGS.learning_rate,
  )
AttributeError: module 'numpy' has no attribute 'int'.
`np.int` was a deprecated alias for the builtin `int`. To avoid this error in existing code, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
The aliases was originally deprecated in NumPy 1.20; for more details and guidance see the original release note at:
    https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations

Apparently bsuite uses np.int which is deprecated, and bsuite does not seem to be maintained anymore. I fixed it editing it manually.