CUDNN failure: CUDNN_STATUS_BAD_PARAM-src/cudnn/conv2d_kernel.cu

jiazhihao / TASO

The Tensor Algebra SuperOptimizer for Deep Learning

Apache License 2.0

687 stars 90 forks source link

CUDNN failure: CUDNN_STATUS_BAD_PARAM-src/cudnn/conv2d_kernel.cu #42

Open qunluo opened 4 years ago

qunluo commented 4 years ago

Hi, I try to optimize onnx model, but got CUDNN_STATUS_BAD_PARAM error at src/cudnn/conv2d_kernel.cu:149. My onnx model could be downloaded from https://drive.google.com/open?id=1JOoKnXf69hbBpyAWMIEhHdc4Iapv5kcR.

jiazhihao commented 4 years ago

@qunluo I was able to reproduce the bug. It is because the ONNX file you used didn't specify a batch size for the input tensor, and TASO assumed a batch size of zero. You can fix the bug by changing the unknown batch size to a specific number.

qunluo commented 4 years ago

@jiazhihao when using the onnx model with batch size 1, I got the new error as follows: node.attribute.append(attr) AttributeError: 'google.protobuf.pyext._message.RepeatedCompositeCo' object has no attribute 'append' The new onnx model could be downloaded from https://drive.google.com/open?id=1mYZXogNcOi1Egw3fLAnR6wnp1C9-Sl9V.