[BUG/Help] CUDA error: an illegal memory access was encountered

[suckseed5]

Is there an existing issue for this?

• [X] I have searched the existing issues

Current Behavior

有没有人遇到这个问题，同样的数据在A100-40G（cuda-11.4）上，一跑就报错：

Expected Behavior

No response

Steps To Reproduce

finetune

Environment

- OS:Ubuntu 20.04
- Python: 3.9
- Transformers: 4.31.0
- PyTorch: 2.0.1
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :True 11.4

Anything else?

No response