-
Hello, Dr.Haydari. I am an undergraduate student engaging in safe RL, and I also tried to implement CSAC/SAC-Lagrangian in pytorch.
I was wondering :
① if it is necessary to apply extra critic netwo…
-
I have a non-distributed repro that uses float8: below is a mini model that is basically float8linear + relu, wrapped in an SAC region that wants to recompute everything except matmuls (requires insta…
-
Hi.
I ran the "simple example" in "Visualizing Rollouts". However, I get the following error: Can anyone please tell me how to deal with it?
python scripts/rollout.py --load_dir runs/Wipe-Panda-…
-
Hi JongseongChae, I am wondering how to only run Gail algorithm using your code. Could you give me the run example for gail?
-
When running evaluations during training or enjoy.py the first episode always performs poorly, while the subsequent episodes are more in line with the expected performance. Initially I thought it was …
-
I'm new to sqlite so may be missing something. A dump of the tables gives:
[('survey',), ('generations',), ('images',), ('sqlite_sequence',), ('paths',), ('ratings',), ('upscales',)]
I look in ratin…
-
On running the lagrangian version of SAC I get the following curve for costs. I tried changing the constraint limits to a range of values and didn't get much benefit:
![lagrangian_sac_pointgoal1](h…
-
Four keypoints:
1. Learning Dynamics.
- Firstly try: Ensemble Dynamics using MSE. (MB-MPO)
- Then, try RNN.
- Model uncertainty: MDN or GANonZ , on 1234 dataset.
- Afterwards: Use …
-
https://github.com/openai/spinningup/blob/038665d62d569055401d91856abb287263096178/spinup/algos/pytorch/sac/core.py#L53-L67
In line 64 of the code above, the squashing function (tanh) is applied to…
-
This example dataset based trainer also does expert signal recollection, so that is why I didnt do a PR, will let it to you to decide which parts make sense for rlkit.
```python
class OptimizedBat…