Open qyc-98 opened 2 years ago
Hi
I'm running squence_parallel for bert pre-training, but I got this problem
What could I do to solve this problem?
Thanks!
CUDA 11.1 torch 1.12.0 python 3.8.13 colossalai 0.1.7 Device RTX 3090
Hi Can you run colossalai check -i ?
colossalai check -i
Hi, this is result.
🐛 Describe the bug
Hi
I'm running squence_parallel for bert pre-training, but I got this problem![b465612bbf66f370c18248b5d6f86bf](https://user-images.githubusercontent.com/38046403/177959217-96fcaf70-1829-4d85-80d2-277277584658.png)
What could I do to solve this problem?
Thanks!
Environment
CUDA 11.1 torch 1.12.0 python 3.8.13 colossalai 0.1.7 Device RTX 3090