-
**Problem:**
When attempting to run the example code in real turtlebot within a Docker container, I encountered the error:
_mat1 and mat2 shapes cannot be multiplied_
**My run steps**
I ru…
-
Comment below with questions or thoughts about the reading for [this week's workshop](https://github.com/uchicago-computation-workshop/Fall2019/tree/master/10-24_Turner).
Please make your comments …
-
## Describe the bug
When using SAC Discrete but the actor or the critic architectures contains an LSTM or a GRU module, the following error is raised:
> *** TypeError: cannot assign 'torch.cuda.…
-
### What happened + What you expected to happen
Good morning!
As in #40347 I have the same problem for the DreamerV3 algorithm.
By the train.py script I made 500 iterations of training and ha…
-
**Important Note: We do not do technical support, nor consulting** and don't answer personal questions per email.
Please post your question on the [RL Discord](https://discord.com/invite/xhfNqQv), [R…
-
A [homoiconic](https://en.wikipedia.org/wiki/Homoiconicity) programming language can parse itself to an AST expressed as native data that can be transformed within the language, evaluated, or isomorph…
-
When running step3 with following step, it is hanging. Is there any way to fix this up?
- run scripts
```
#!/bin/bash
# Copyright (c) Microsoft Corporation.
# SPDX-License-Identifier: Apache-2.…
-
A friend of dwyl asked the following question in our "chat" system:
![question-using-elixir-rest-api](https://user-images.githubusercontent.com/194400/49619100-06012280-f9b3-11e8-96a1-bf929b17bf08.…
-
首先非常感谢这个库,可以让多个13b的模型进行rlhf并起到不错的效果。
问题:在 https://huggingface.co/baichuan-inc/Baichuan2-13B-Base进行内部多轮数据sft后的对齐模型 + openrlhf 提供的 rm-anthropic_hh-lmsys-oasst-webgpt.pt 出现异常如下
(CriticModelRayActo…
-
运行脚本:
```
../train_ppo.py \
--pretrain /data/chuxiong/chinese-llama-2-7b-eot \
--critic_pretrain /data/chuxiong/chinese-llama-2-7b-eot \
--reward_model_path ./ckpt/chinese-llama-2-7b-…