-
This example dataset based trainer also does expert signal recollection, so that is why I didnt do a PR, will let it to you to decide which parts make sense for rlkit.
```python
class OptimizedBat…
-
Hi,
Thank a lot for your helpful implementation!
After checking several SAC repos, I came into a question:
why _log_alpha_ is used (instead of _alpha_) for entropy calculation as in line 306 of…
-
group_list = [action, 2],这个应该是随便设置的吧qaq
我复制上面的action粘贴了一个action2
设置了一个action1,一个action2,请问这样可以吗?
感觉很难收敛欸qaq
-
Hey Jingliang, just saw your paper for the first version of DSAC.
It is impressive and clear. I am quite interested in the implementation of TD4, which is quite interesting in my view.
Would you …
-
I'm sorry to bother you. I want to ask the difference between the two ways to get pre-training models. I don't know if I understand correctly
**The first is in the ''Getting a pre-trained model for f…
-
## Motivation
I suggest adding an implementation of [TQC](https://github.com/SamsungLabs/tqc_pytorch) to the examples. I suggest adding this as a request in the 'call for distributions' stack. I wo…
-
### 🐛 Bug
Hello. I am trying to reproduce some algorithms or experiments, to record some data. But some expectation happens, nan is generated for some unknown reasons. Any advice to solve?
### T…
-
Disclaimer: I am not completely sure if this is a bug of PFRL.
When I ran SAC, and TD3 on my university's cluster without a GPU, I observed that memory usage gradually increased and finally reached…
-
`tb-reducer ant_sac/*seed*/log/serial/ -o out -r mean,std,min,max --lax-steps`
Although I used `--lax-steps` flag, some tags only contain one data point. Others are fine.
![image](https://user-image…
-
### 🐛 Describe the bug
As titled. To repro:
1. Remove the `@unittest.skip` block on top of
`test/dynamo/test_activation_checkpointing.py::ActivationCheckpointingViaTagsTests::test_compile_selective…
yf225 updated
5 months ago