Error goes with“Check failed: err == cudaSuccess || err == cudaErrorInvalidValue Unexpected CUDA error: invalid argument”

EdjeElectronics / TensorFlow-Object-Detection-API-Tutorial-Train-Multiple-Objects-Windows-10

How to train a TensorFlow Object Detection Classifier for multiple object detection on Windows

Apache License 2.0

2.93k stars 1.3k forks source link

Error goes with“Check failed: err == cudaSuccess || err == cudaErrorInvalidValue Unexpected CUDA error: invalid argument” #527

Open NE-MI-EM opened 4 years ago

NE-MI-EM commented 4 years ago

Hi！Error as mentioned above occurs when I typed "python train.py --logtostderr --train_dir=training/ --pipeline_config_path=training/faster_rcnn_inception_v2_pets.config"

I have TF 1.15.3 and my CUDA versions are v10.0 and v10.1 (v10.0 is for this poker detection and v10.1 is for other tasks), and cuDNN is 7.4.2 for both CUDA versions. My GPU is RTX 2060.

I am not sure if I provide enough information so I printscreen as follows. Thanks for helping in advance.

NE-MI-EM commented 4 years ago

Update: I uninstalled CUDA v10.0, v10.1 and cuDNN v7.4.2 and installed CUDA v10.2 and cuDNN v7.6.5 and still got the same error. So I assume the problem is not with my CUDA and cuDNN version