-
Hello, when I run Formation task with `algo=mappo`, I got:
When I use `algo=ppo`, I got:
…
-
### 🐛 Describe the bug
Passing dict in datapipe or dataset will casuse memory leak
```python
from copy import deepcopy
import gc
from memory_profiler import profile
import torch
from torc…
-
### 🚀 The feature, motivation and pitch
[TorchRL](https://github.com/pytorch/rl/) and [tensordict](https://github.com/pytorch-labs/tensordict) could use nested tensors extensively, but we're facing s…
-
### 🐛 Describe the bug
This snippet fails
```python
import torch
device = torch.device("cuda:0")
a = torch.nested.nested_tensor_from_jagged(values=torch.randn(10), lengths=torch.tensor([2, 3, 5])…
-
Hi!
I followed the Getting Started instructions but was unable to run the examples, as agenthive does not work with the most recent versions of the dependencies.
Could you detail which package v…
-
## Describe the bug
Not quite sure if this is supported behavior, but if I set `functional=True` for the A2C loss and `shifted=True` for `TD0Estimator` I get an internal error.
## To Reproduce
…
-
## Describe the bug
For some reason (probably unrealted to tensordict), functorch dims fails with big tensors.
```python
import torch
from tensordict import TensorDict
# build splits
total…
-
## Describe the bug
I have observed a considerable decrease in policy performance after the recent PyTorch 2.5.0 update. The decrease in performance replicates when training with A2C, REINFORCE and…
-
Hi there 👋🏼
First of all, thanks a lot for your library, it has inspired several works in our research group!
We are actively developing [RL4CO](https://github.com/kaist-silab/rl4co), a library fo…
-
## Describe the bug
When I proceeded further based on the issue https://github.com/pytorch/rl/issues/2402
I have already made modifications based on the suggestions according to the issue above, b…