-
### Question
I'm trying to implement sampling and training asynchronously using the SAC algorithm. I made the attempt shown in the code below. But I always get an error because there seems to be a …
-
Hello, when I the command `python launch_experiment.py`, there is an error occurring——
"""
Traceback (most recent call last):
File "/home/charlie/anaconda3/envs/CORRO/lib/python3.6/multiprocess…
-
## 🐛 Bug
After the Adam optimizer used weight_decay, the model became extremely slow when tested on the CPU.(Time from 7 seconds to 46 seconds)
## To Reproduce
Steps to reproduce the behavior…
-
## Motivation
Twin Q/ensemble Q functions are used in many RL algorithms and mitigate Q overestimation. My understanding is that TorchRL only deals with ensembles in the loss functions. This is fine …
-
Repro code:
```
import sim
import time
import config as c
env = sim.start(map=c.CANYONS_MAP_NAME)
while True:
time.sleep(5)
print("Resetting")
res = env.reset()
print("Rese…
-
This is a tracking issue for the second iteration of this project.
**CAD/Mechanical Assembly:**
- [x] #29
- [x] #22
- [x] #30
- [x] #31
- [ ] finish designing the part to mount the slip ring t…
-
I would like to resume training from a given epoch. I guess I could add a line to:
def get_epoch_snapshot(self, epoch):
data_to_save = dict(
epoch=epoch,
expl…
-
I have visited the [source website](https://github.com/thu-ml/tianshou/)
I have searched through the [issue tracker](https://github.com/thu-ml/tianshou/issues) for duplicates
I have mentioned versio…
-
If I use add_graph multiple times, the writer overwrites all the previous networks graphs and displays only the last graph. Is this the expected behaviour?
writer = Summarywriter()
writer.add_sca…
-
This is a follow-up to #913
# Motivation
Add full support for multi-process and multi-GPU training in alf with pytorch's [DDP](https://pytorch.org/docs/stable/notes/ddp.html).
# Goals
- […