When I use 8 A40 images to continue pre-training the XLSR-53 2B pre-training model, I always get an error message: Expected is_sm80 to be true, but got false. (could this error message be improved? If so, please report an enhancement request to pytorch) How can I solve this problem?

facebookresearch / fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

MIT License

30.57k stars 6.41k forks source link

When I use 8 A40 images to continue pre-training the XLSR-53 2B pre-training model, I always get an error message: Expected is_sm80 to be true, but got false. (could this error message be improved? If so, please report an enhancement request to pytorch) How can I solve this problem? #5553

Open Learneducn opened 1 month ago

Learneducn commented 1 month ago

🐛 Bug

To Reproduce

Steps to reproduce the behavior (always include the command you ran):

Run cmd '....'
See error

Code sample

Expected behavior

Environment

fairseq Version (e.g., 1.0 or main):
PyTorch Version (e.g., 1.0)
OS (e.g., Linux):
How you installed fairseq (pip, source):
Build command you used (if compiling from source):
Python version:
CUDA/cuDNN version:
GPU models and configuration:
Any other relevant information:

Additional context

Learneducn commented 1 month ago

When I use 8 A40 images to continue pre-training the XLSR-53 2B pre-training model, I always get an error message: Expected is_sm80 to be true, but got false. (could this error message be improved? If so, please report an enhancement request to pytorch) How can I solve this problem?