-
**Describe the bug**
Cannot get the same attention calculation results from deepspeed's `dense_blocked_attention` and flash_attn's `flash_attn_varlen_func`. I just give my own params.
**To Reprod…
-
I ran all_to_all and passed pre1, pred2, but after that got memory error.
a_stack/triangle_multiplication_outgoing/gating_linear/...cb,cd->...db/jit(_einsum)/dot_general[dimension_numbers=(((0,), …
-
Hello,
I'm trying to install ESMfold locally and am struggling. When I paste the following code into the terminal, I get an error message.
pip install "fair-esm[esmfold]"
pip install 'dllogger …
-
I build deepspeed from the source code, and the version is 0.10.4+dcd3ae1
here is the ds_report.
```
DeepSpeed C++/CUDA extension op report
--------------------------------------------------
NOT…
-
Hi, I am trying the 'cifar10_deepspeed.py' [here](https://www.deepspeed.ai/tutorials/cifar-10/) on a single node (2x3090). When I run the command below:
```bash
deepspeed cifar10_deepspeed.py --deep…
-
When running step3 with following step, it is hanging. Is there any way to fix this up?
- run scripts
```
#!/bin/bash
# Copyright (c) Microsoft Corporation.
# SPDX-License-Identifier: Apache-2.…
-
/scratch/valiente/anaconda3/envs/dl_binder_design/lib/python3.9/site-packages/Bio/Data/SCOPData.py:18: BiopythonDeprecationWarning: The 'Bio.
Data.SCOPData' module will be deprecated in a future rele…
-
build_win.bat
Administrative permissions required. Detecting permissions...
Success: Administrative permissions confirmed.
NOTE: Redirects are currently not supported in Windows or MacOs.
DS_BUILD…
-
**Describe the bug**
Training fails due to "exits with return code = -7" without further explanations.
The is the full log:
```
root@5b7db410cd49:/app/dream_llm/casual_lm# deepspeed --num_gpus=4 r…
-
When I set up the environment, in the final step as below, the error happens.
the final step, pip install 'openfold @ git+https://github.com/aqlaboratory/openfold.git@4b41059694619831a7db195b7e098…