Open CivilLion opened 2 days ago
This error has occurred on two computers. I pulled this from one of them.
2024-11-24 19:49:58.7213964 [E:onnxruntime:Default, cuda_call.cc:116 onnxruntime::CudaCall] CUBLAS failure 13: CUBLAS_STATUS_EXECUTION_FAILED ; GPU=0 ; hostname=LED-PC ; file=D:\a_work\1\s\onnxruntime\core\providers\cuda\math\gemm.cc ; line=121 ; expr=cublasGemmHelper( GetCublasHandle(ctx), CUBLAS_OP_N, CUBLAS_OP_N, N, M, 1, &one, b_data, N, GetConstOnes(M, Stream(ctx)), 1, &zero, out_data, N, device_prop); 2024-11-24 19:49:59.0917094 [E:onnxruntime:, sequential_executor.cc:514 onnxruntime::ExecuteKernel] Non-zero status code returned while running Gemm node. Name:'Gemm_568' Status Message: CUBLAS failure 13: CUBLAS_STATUS_EXECUTION_FAILED ; GPU=0 ; hostname=LED-PC ; file=D:\a_work\1\s\onnxruntime\core\providers\cuda\math\gemm.cc ; line=121 ; expr=cublasGemmHelper( GetCublasHandle(ctx), CUBLAS_OP_N, CUBLAS_OP_N, N, M, 1, &one, b_data, N, GetConstOnes(M, Stream(ctx)), 1, &zero, out_data, N, device_prop);
It proceeds to process for a few frames, then hangs.
Both Windows 10 One has NVidia Geforce GTX 1050 Ti, and the other NVidia Geforce GTX 1060 3GB
Running on 4.3.3
It started after a recent Windows update. Could that be a factor?
This error has occurred on two computers. I pulled this from one of them.
2024-11-24 19:49:58.7213964 [E:onnxruntime:Default, cuda_call.cc:116 onnxruntime::CudaCall] CUBLAS failure 13: CUBLAS_STATUS_EXECUTION_FAILED ; GPU=0 ; hostname=LED-PC ; file=D:\a_work\1\s\onnxruntime\core\providers\cuda\math\gemm.cc ; line=121 ; expr=cublasGemmHelper( GetCublasHandle(ctx), CUBLAS_OP_N, CUBLAS_OP_N, N, M, 1, &one, b_data, N, GetConstOnes(M, Stream(ctx)), 1, &zero, out_data, N, device_prop);
2024-11-24 19:49:59.0917094 [E:onnxruntime:, sequential_executor.cc:514 onnxruntime::ExecuteKernel] Non-zero status code returned while running Gemm node. Name:'Gemm_568' Status Message: CUBLAS failure 13: CUBLAS_STATUS_EXECUTION_FAILED ; GPU=0 ; hostname=LED-PC ; file=D:\a_work\1\s\onnxruntime\core\providers\cuda\math\gemm.cc ; line=121 ; expr=cublasGemmHelper( GetCublasHandle(ctx), CUBLAS_OP_N, CUBLAS_OP_N, N, M, 1, &one, b_data, N, GetConstOnes(M, Stream(ctx)), 1, &zero, out_data, N, device_prop);
It proceeds to process for a few frames, then hangs.
Both Windows 10 One has NVidia Geforce GTX 1050 Ti, and the other NVidia Geforce GTX 1060 3GB
Running on 4.3.3
It started after a recent Windows update. Could that be a factor?