-
Hi! Thanks for your great sharing!
I met the `72956 segmentation fault` when I tried to train the task with `Pixels` suffix like `FrankaPickPixels`.
Besides, I have finished the training success…
-
Attempting the spinning up tutorial using windows and wsl2 by following the link given in the installation tutorial.
After setting up conda and wsl2, I made my conda environment, then followed the …
-
### 🐛 Bug
Hey,
thanks a lot for your work!
I am trying to debug an apparent memory leak/higher memory usage when running the training code multiple times, but I can't pinpoint its cause.
I've bo…
-
Hi @vwxyzjn ,
This codebase is great, thanks for the hard work! I've been using it to run baseline experiments in procgen, and I've noticed that your implementation of PPO does not use value loss c…
-
(array([-0.02680779, 0.00466264, -0.02511859, -0.04842809], dtype=float32), {})
Traceback (most recent call last):
File "main.py", line 31, in
action, prob, val = agent.choose_action(observ…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
https://github.com/shibing624/MedicalGPT
参考这个项目,预训练,指令微调,rm模型训练,ppo都有现成的。
### Expected Beha…
-
In the Pytorch implementation of the algorithms, there is a slight issue with computing value of terminal state. Let's look at the example of PPO:
Line 321 in `ppo.py`:
`if timeout or epoch_ended:…
-
It seems that you should clamp ratio, not surr1.
https://github.com/alexis-jacq/Pytorch-DPPO/blob/master/ppo.py#L145
-
Is there a particular reason why `VecNormalize` is only applied to 1-D observations? If yes, wouldn't it make sense to apply at least the rewards normalization?
https://github.com/ikostrikov/pytorch-…
-
This is found via https://github.com/pytorch-labs/torchfix/
`torch.load` without `weights_only` parameter is unsafe. Explicitly set `weights_only` to False only if you trust the data you load and f…