RuntimeError: CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling `cublasSgemmStridedBatched( handle, opa, opb, m, n, k, &alpha, a, lda, stridea, b, ldb, strideb, &beta, c, ldc, stridec, num_batches)`

[gwen233666]

Traceback (most recent call last): File "train.py", line 527, in training(lp.extract(args), op.extract(args), pp.extract(args), dataset, args.test_iterations, args.save_iterations, args.checkpoint_iterations, args.start_checkpoint, args.debug_from, wandb, logger) File "train.py", line 87, in training scene = Scene(dataset, gaussians, ply_path=ply_path, shuffle=False) File "/home/huigang/Scaffold-GS/scene/init.py", line 82, in init self.train_cameras[resolution_scale] = cameraList_from_camInfos(scene_info.train_cameras, resolution_scale, args) File "/home/huigang/Scaffold-GS/utils/camera_utils.py", line 59, in cameraList_from_camInfos camera_list.append(loadCam(args, id, c, resolution_scale)) File "/home/huigang/Scaffold-GS/utils/camera_utils.py", line 53, in loadCam image_name=cam_info.image_name, uid=id, data_device=args.data_device) File "/home/huigang/Scaffold-GS/scene/cameras.py", line 56, in init self.full_proj_transform = (self.world_view_transform.unsqueeze(0).bmm(self.projection_matrix.unsqueeze(0))).squeeze(0) RuntimeError: CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemmStridedBatched( handle, opa, opb, m, n, k, &alpha, a, lda, stridea, b, ldb, strideb, &beta, c, ldc, stridec, num_batches)

Hello, thank you for your excellent work, but I have encountered the following problems during training. Could you please give me some advice? Thank you in advance.

[inspirelt]

Hi, I would suggest you to try to change the pytorch and cuda version.