-
Hello,
I'm sorry for asking so many questions. But would you know how to go about saving and loading the subclassed model? I have tried everything I can think of including trying to change the subc…
-
Using Tensorflow TRPO for the OpenAI gym MountainCar-V0 environment doesn't converge every run. Some runs might converge to a good policy. Others will stay at -200 reward forever.
Gist of code atte…
-
Why in TRPO tf1 implementation update is subtracted. Opposite to what is said in paper and SpinUp doc.
```
def set_and_eval(step):
sess.run(set_pi_params, feed_dict={v_ph: old_params - alpha …
-
Hi, thanks for your implementation of TRPO.
In [https://github.com/wojzaremba/trpo/blob/master/main.py#L128-L132](url) you normalize an advantage function.
I couldn't find any description about th…
-
I successfully installed rllab, and the trpo_cartpole.py example worked fine, but I'm getting an error with trpo_gym.py:
```
Traceback (most recent call last):
File "trpo_gym.py", line 6, in
…
-
@antoine-galataud @takaomoriyama
Hello, I've been working on this project for a long time and I've trained the model using the TRPO policy for over 2000 epochs, but the reward would get stabalised e…
-
Hello,
executing `python -m baselines.run --alg="deepq" --env="QbertNoFrameskip-v4" --num_timesteps="1e4" --log_path="~/logs/"` will not produce any monitor.csv files.
Only trpo and deepq are affect…
-
Hi, I shifted from TRPO to PPO2, and I know how to train the model and save it and then re-train the saved model in TRPO.
But, in PPO2, I don't know the code for it.
@antoine-galataud you had on…
-
Pearlmutter method only gives "good" value of hessian vector product in the first two iterations in conjugate gradient loop
-
See the `feature/fix_lstm` branch for [a test](https://github.com/hill-a/stable-baselines/blob/feature/fix_lstm/tests/test_lstm_policy.py) which [fails](https://travis-ci.com/hill-a/stable-baselines/b…