search

bigscience-workshop / Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2
Other
1.3k stars 211 forks source link

RuntimeError: Error building extension 'scaled_upper_triang_masked_softmax_cuda' #387

Open zll0000 opened 1 year ago

RoccOcean commented 11 months ago

maybe you should create the project on Ubuntu instead of CentOS