-
**Describe the bug**
I am training a video-llm model, where I encode log videos with a varying number of forward passes to avoid OOM issues. I would like to use ZeRO3, but using a part of the model a…
-
Hi,
Thanks for the conversion script. It worked on AlphaFold Multimer 2.2.0 but when I run the same command on AlphaFold 2.3.0
I guess that's because AlphaFold changed the layout of outputs in 2…
-
I tried to predict a 5 subunit complex (in total ~5000 aa) and get the following error with various settings (1-4x A100 80GB, w/ and w/o --inplace, w/ and w/o --chunk_size 1-32). The error seems to be…
-
**Describe the bug**
Hi,
```python
import torch
from deepspeed.ops.adam import DeepSpeedCPUAdam
fused_adam = DeepSpeedCPUAdam([torch.rand(10)])
```
yields `[WARNING] cpu_adam cuda is missi…
-
**Describe the bug**
I am having issues infering the model after installing deepspeed for windows. my configuration is mentioned below, is there anyway we can perform inference with just a python scr…
-
I tried to use the newly open-sourced DiG code to make 1ake example prediction for 100 samples, but all conformations are mainly around 1ake experimental structure, deviate away from 4ake structure. I…
-
Can you provide init training and finetune training settings?
model config, data config, not just table1 in the paper.
e.g. whether use struct model? whether enable template? whether use extra m…
-
## 論文リンク
https://www.nature.com/articles/s41586-021-03819-2
(Supplementary Information も同ページにリンクがある)
## 公開日(yyyy/mm/dd)
2021/07/15
## 概要
タンパク質の構造予測コンペである CASP14 において他チームを圧倒した精度を達成した AlphaFol…
-
**Describe the bug**
I'm using DeepSpeed MoE layer to build a multi-modal LLM, I'm using Phi-3 as the base model, and replaced the MLP layer with MoE layer in DeepSpeed. However, when I enabled exper…
-
How much GPU memory is required to run the example? I've tried on a GPU with 24GB and am getting OOM errors. What cards have you tested on?