-
# setting environment
そもそもexamplesのために環境設定するのか....
[EXAMPLES.md](https://github.com/sakakibara-yuuki/rl/blob/main/examples/EXAMPLES.md)に従う.
-
Hello, I need to make SacAgent work with discrete action, so try to implement GumbelSoftmax parameterization trick by re-defining the relevant classes. However, the calculation of `agent.train(experie…
-
Hi,
I am using torch 2.5.0.dev20240617+cu121 and I have the following error unsolved.
```
[rank0]:[rank0]: File "...../torchtitan/parallelisms/parallelize_llama.py", line 50, in checkpoint_wrapp…
-
Is this project active? (I don't see any other way to message Josiah.) I've been thinking of working on something similar but would rather contribute to an existing project than start from scratch. Bu…
-
I've tried to make the environment work with the baselines fork stable_baselines (https://github.com/hill-a/stable-baselines). It runs, but the results shown when I'm running plot_energyplus is always…
-
I wonder if lstm+ppo/sac could use in Tianshou? Since there are some problems.
-
SAC exists as an API today (see [code](https://github.com/pytorch/pytorch/blob/main/torch/utils/checkpoint.py#L1256)), but:
(1) it "context" fn has a pt2-specific name
(1) We have a warning in the…
-
### 🐛 Bug
I use sb3 for myochallenge, and the env is the myoChallengeBimanual-v0.
When I try to use vecEnv (both SubprocVecEnv and DummyVecEnv), I got warnings like this
```shell
WARN: The env…
-
In the CQL trainer, the policy_loss is formulated before the QF_Loss is, but the QF_Loss backprops the policy network before policy_loss does, which causes a Torch error. Would the intended use be to …
-
### 🐛 Bug
I'm trying to use SAC + HER (both from SB3) with a custom environment.
My environment has the following observation and space definitions:
```
self.observation_space = Dict({'obser…