-
Hi, thank you very much for providing the code. When I executed ppo_training_mh, I encountered the error code below.
The package versions I use are the same as yours except pytorch-geometric(2.5.3)
…
-
# Dataset
1. Refactor the self cognition dataset to support multi-lingual QAs.
# Megatron PreTrain
1. Support more Megatron models
2. Support dataset split
# Fine-tuning
1. RAG LLM training …
-
Hello, apologies if I do this wrong I don't contribute to open source often. I was attempting to run the Pytorch PPO implementation and kept getting several errors regarding the dimension of the obser…
-
Is there a reason you calculate the reward the way you do in line 69?
https://github.com/toshikwa/gail-airl-ppo.pytorch/blob/4e13a23454600a16d5aeeeb4c09338308115455e/gail_airl_ppo/algo/airl.py#L69
…
-
### 🐛 Bug
I tested different implementations of the PPO algorithm and found some discrepancies among the implementations. I tested each implementation on 56 Atari environments, with five trials per…
-
Trying to follow the simple README instructions on an Ubuntu server with 2x 4090 GPUs and CUDA 12.4:
```bash
Installing the current project: cleanrl (2.0.0b1)
(cleanrl) ➜ cleanrl git:(master) po…
catid updated
1 month ago
-
**Describe the bug**
We followed [Accelerated-RLHF.md](https://github.com/NVIDIA/NeMo-Aligner/blob/v0.3.0.trtllm/Accelerated-RLHF.md) to run the accelerate the PPO training by using TensorRT-LLM. A…
-
While testing the model i get this:
Traceback (most recent call last):
File "test.py", line 65, in
test(opt)
File "test.py", line 55, in test
state, reward, done, info = env.step(act…
-
Hello,
I followed steps mentioned [here](https://github.com/ikostrikov/pytorch-a2c-ppo-acktr-gail#requirements) to install requirements for this repository. There is one minor change, I am using vi…
-
`pip install stable-baselines3[extra]`
## Repro
```python
from stable_baselines3 import PPO
import torchdynamo
@torchdynamo.optimize("inductor")
def train():
model = PPO("MlpPoli…