search

fundamentalvision / Deformable-DETR

Deformable DETR: Deformable Transformers for End-to-End Object Detection.
Apache License 2.0
3.23k stars 520 forks source link

Getting CUDA Runtime error while training Deformable DETR #137

Closed dnvnxg closed 2 years ago

dnvnxg commented 2 years ago

During training we get the following error. Has anyone gotten a similar error or successfully trained recently?

RuntimeError: CUDA error: CUBLAS_STATUS_INTERNAL_ERROR when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc)

dnvnxg commented 2 years ago

Issue was resolved in an update to mmcv-full