-
```
python -m scripts.run_probe --method infonce-stdim --env-name Pong-v0
```
Traceback (most recent call last):
File "/home/duane/anaconda3/envs/atari-representation-learning/lib/python3.7/ru…
-
## ❓ Questions and Help
I already integrated habitat env into the [A2C](https://github.com/ikostrikov/pytorch-a2c-ppo-acktr-gail). It works in `--num-processes 1`. However, when I set `--num-processe…
-
Checklist:
- [x] Parallelized training for experts (Adam finished this via #57).
- [x] Get good experts for Humanoid and Ant [which are not doing well right now](https://github.com/HumanCompatib…
-
Hello. I am not very familiar with reinforcement learning.
python3 main.py --log-dir trained_models/acktr --algo acktr --model squeeze --num-process 24 --map-width 27 --render
In the above, mai…
-
As the differential entropy of a Gaussian distribution is dependent only on the standard deviation, how does adding it to the actor loss function promote exploration? Isn't the gradient of the differe…
-
https://github.com/ikostrikov/pytorch-a2c-ppo-acktr-gail/blob/d4c68c1ce8d87a7c4ae7a7d88b54daa197785fc4/a2c_ppo_acktr/storage.py#L167
It seems awkward. I think it should be
`self.recurrent_hidden_…
-
I'm going to take care of this. I made a separate branch to deal with it: dev_schrum_ppo
The goal is to make sure that we didn't break PPO by moving it into this code base.
-
We eventually need to be able to do this either in the PPO code that uses tensorflow, or in PyTorch (but we would need a working deep RL algorithm in PyTorch first). Either way, we have to have some w…
-
I'm trying to understand the implementation of the hidden states and masks in the recurrent policy (say, using the MLPBase). There has been some commentary on it, e.g., in #82 and #52. Maybe @ikostrik…
-
https://github.com/ikostrikov/pytorch-a2c-ppo-acktr-gail/blob/8a4a500b8bd7a7c10f7b3fbcaebcfdb6d62ef7d4/a2c_ppo_acktr/storage.py#L122-L125
`drop_last` should be `True`.
There is a potential case…