-
Is there a particular reason why `VecNormalize` is only applied to 1-D observations? If yes, wouldn't it make sense to apply at least the rewards normalization?
https://github.com/ikostrikov/pytorch-…
-
When using the command described in the top Readme but for Breakout and with acktr, the program terminates after the given time steps. No result file is written.
I'm using tensorflow-gpu 1.13.1 wit…
-
It seems that your model can only work on netlists with num_cell = 710. I have to make a lot of revisions to fit DeepPlace to other datasets.
-
Instead of using different default arguments for different algorithms, create config files and load arguments from there.
-
The policy is given the last recurrent state from the replay buffer and isn't reset between episode boundaries. In my case I have the number of updates set to the episode length, so I've added `rollou…
bamos updated
4 years ago
-
In contrast to A2C and A2C_ACKTR, PPO already includes a learning rate scheduling performed by Adam. In supervised learning it is debatable if one should use manual scheduling in combination with Adam…
-
In contrast to A2C and A2C_ACKTR, PPO already includes a learning rate scheduling performed by Adam. In supervised learning it is debatable if one should use manual scheduling in combination with Adam…
-
While training, the number of frames used so far is computer as
`total_num_steps = (j + 1) * args.num_processes * args.num_steps`
Shouldn't this be multiplied by the number of stacked frames (def…
-
`Agent`s are entities with a `sample_action` and `update` method, in potence.
We exclude from the list exploration strategies and curricula.
_Implement_ means either to produce new code from the pape…
-
Can you list the exact commands you would run to install the dependencies? Then we can make a Dockerfile so people can run it as a docker container on any computer/server without installing anything.