-
**Machine: MAX1100**
**ipex-llm: 2.1.0b20240421**
**bigdl-core-xe-21 2.5.0b20240421
bigdl-core-xe-esimd-21 2.5.0b20240421**
[Related PR](https://github.com/intel-analytics/ipex-llm…
-
## Describe the bug
When you get a tensordict rollout of shape `(N_envs, N_steps, C, H, W)` out of a collector and you want to apply an advantage module that starts with `conv2d` layers:
1. direct…
-
Right now when `compile=True`, only the model is compiled
https://github.com/pytorch/torchtune/blob/e10142016798cf84f2e5c638a985014384f400a7/recipes/lora_finetune_single_device.py#L383-L386
We c…
-
I run PPO torch to train HalfCheetah-v2 with the following command line.
"python -m spinup.run ppo_pytorch --exp_name ppo_halfcheetah --env HalfCheetah-v2 --hid[h] [64,32] --act torch.nn.ReLU --se…
-
I am new on this code, My question is that if i want to get the grad on the CNN layer by using register_backward_hook function. Should I remove the code "with torch.no_grad():" when training this mode…
-
Our modules only work with generation under two conditions: batch_size = 1 or every single sample in a batch has the same length. The main culprit is this line of code: https://github.com/pytorch/torc…
-
Dear Author,
When I set num_processes=1, some errors occur, i could be a bug.
`File "/home/ken/project/pytorch-a2c-ppo-acktr-gail/a2c_ppo_acktr/envs.py", line 232, in step_wait
self.stacked…
-
@xluox
### How to reproduce
```
git clone https://github.com/xluox/gym-microrts.git --recurse-submodules
cd gym-microrts
git checkout PCG
git pull --recurse-submodules
poetry install
poet…
-
I noticed that the predict reward function uses log(D(.)) - log(1-D(.)) as the reward to update the generator. However, this is the reward function proposed in the AIRL paper which minimizes the rever…
-
目前在文档中看到本项目实现了非常丰富的智能体模型算法,以及不同类型Env的适配,但是好像具体的benchmark试验结果汇总比较有限,存在大量的结果缺失,例如[Atari](https://xuance.readthedocs.io/zh/latest/documents/benchmark/atari.html)、MPE、MAgent等均无试验结果展示,仅有的Mujoco试验结果也不是很完整,仅…