-
环境:nvidia a10 24g显存,docker:nvidia/cuda:11.8.0-cudnn8-devel-ubuntu20.04,cpu:Intel® Xeon® Silver 4314×2,mem:256G
日志如下:
NCCL_DEBUG=info NCCL_IB_DISABLE=0 NCCL_NET_GDR_LEVEL=2 deepspeed --master_port 16…
bltcn updated
12 months ago
-
I am facing an issue with the below configuration (was working yesterday and for the last week) where the model loads and dataset is tokenized but then the script hangs (GPU utilization spikes to 100%…
-
我使用ppo ray进行训练。训练会正常的进行若干步,随后出现错误
```
File "/tmp/ray/session_2024-05-24_17-35-31_318483_337945/runtime_resources/working_dir_files/_ray_pkg_d887115d5fd5f465/openrlhf/trainer/ray/ppo_actor.py", line …
-
Hello everyone, I'm encountering a memory issue while fine-tuning a 7b model (such as Mistral) using a repository I found. Despite having 6 H100 GPUs at my disposal, I run into out-of-memory errors wh…
-
This issue is for collecting suggestions.
You can either:
1.Suggest a new feature by leaving a comment.
2.Vote for a feature request with +1 or be against with -1.
3.Tell us that you would like t…
-
Frameworks
[VLDB '20] PyTorch Distributed: Experiences on Accelerating Data Parallel Training
[NeurIPS '19] PyTorch: An Imperative Style, High-Performance Deep Learning Library
[OSDI '18] Ray: A Di…
-
Hey
I wanted to get started with building my own NNUE for chess engine project. I couldn't find any resources that explain the concepts and implementation clearly. Can you help me by suggesting so…
-
Team, thank you so much for this wonderful toolkit! we are trying to test the vllm setting with mistralai/Mistral-7B-Instruct-v0.2 model with zero2
![image](https://github.com/OpenLLMAI/OpenRLHF/a…
-
Joss's editorialbot there https://github.com/openjournals/joss-reviews/issues/6294 found missing DOI's in the paper references:
```
Reference check summary (note 'MISSING' DOIs are suggestions th…
lrnv updated
7 months ago
-
### System Info
- `transformers` version: 4.40.0.dev0
- Platform: macOS-14.4.1-arm64-arm-64bit
- Python version: 3.10.14
- Huggingface_hub version: 0.22.2
- Safetensors version: 0.4.2
- Accelera…