search

rail-berkeley / rlkit

Collection of reinforcement learning algorithms
MIT License
2.43k stars 547 forks source link

Question about VAEPolicy in rlkit.torch.sac.policies #158

Closed HYDesmondLiu closed 2 years ago

HYDesmondLiu commented 2 years ago

In UWAC paper, they did from rlkit.torch.sac.policies import TanhGaussianPolicy, MakeDeterministic, VAEPolicy in examples/UWAC_hdf5_d4rl.py.

However, even in rlkit repository there is no such class. May I know where can I get the latest version of the repository?

anair13 commented 2 years ago

Yes, it looks like it is probably based off of this repo (which extends rlkit): https://github.com/rail-berkeley/d4rl_evaluations/blob/master/bear/rlkit/torch/sac/policies.py

HYDesmondLiu commented 2 years ago

Thank you @anair13 for the pointer, now it makes sense.