clovaai / bros

Apache License 2.0
155 stars 23 forks source link

RuntimeError: CUDA error: CUBLAS_STATUS_EXECUTION_FAILED #14

Closed deepanshudashora closed 1 year ago

deepanshudashora commented 2 years ago

RuntimeError: CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling cublasGemmEx( handle, opa, opb, m, n, k, &falpha, a, CUDA_R_16F, lda, b, CUDA_R_16F, ldb, &fbeta, c, CUDA_R_16F, ldc, CUDA_R_32F, CUBLAS_GEMM_DFALT_TENSOR_OP)

This error while training the model CUDA_VISIBLE_DEVICES=0 python3 train.py --config=configs/custom.yaml