jiazhihao / TASO

The Tensor Algebra SuperOptimizer for Deep Learning
Apache License 2.0
687 stars 90 forks source link

CUDNN failure: CUDNN_STATUS_BAD_PARAM TASO/src/cudnn/element_kernel.cu:193 #39

Open OuHangKresnik opened 4 years ago

OuHangKresnik commented 4 years ago

Just as the title: CUDNN failure: CUDNN_STATUS_BAD_PARAM /disk2/ouhang.oh/experiment/TASO/src/cudnn/element_kernel.cu:193

The op is OP_EW_MUL

ele->inputs[0]

$12 = {static MAX_KEY_LENGTH = 274, static MAGIC_NUMBER = 23333, numDim = 4, dim = {1, 64, 128, 96, 21845, 1068004771, 1050824725, 1075071798}, stride = {786432, 12288, 96, 1, 1068058575, 1050951425, 1075066352, 1050770695}, idx = 0, op = {static INVALID_OP = { static INVALID_OP = , guid = 0, ptr = 0x0}, guid = 255, ptr = 0x555584b2b2b0}, data_ptr = 0x0, split = {{

ele->inputs[1]

$13 = {static MAX_KEY_LENGTH = 274, static MAGIC_NUMBER = 23333, numDim = 3, dim = {64, 1, 1, 1075096021, 1051062975, 1075074253, 1068048265, 1075113656}, stride = {1, 1, 1, 1050865948, 1075080782, 1068015193, 1075058777, 1067985559}, idx = 0, op = { static INVALID_OP = { static INVALID_OP = , guid = 0, ptr = 0x0}, guid = 106, ptr = 0x555583fa0900}, data_ptr = 0x7ffef4625000, split = {{ static NO_SPLIT = { static NO_SPLIT = , num = 0, pos = { 0 <repeats 32 times>}}, num = 0, pos = {1068053135, 1050845104, 1075074414,

ele->outputs[0]

$14 = {static MAX_KEY_LENGTH = 274, static MAGIC_NUMBER = 23333, numDim = 4, dim = {1, 64, 128, 96, 0, 0, 0, 0}, stride = {786432, 12288, 96, 1, 1075072159, 1068021451, 1075087136, 1068032736}, idx = 0, op = {static INVALID_OP = { static INVALID_OP = , guid = 0, ptr = 0x0}, guid = 0, ptr = 0x0}, data_ptr = 0x0, split = {{static NO_SPLIT = { static NO_SPLIT = , num = 0, pos = { 0 <repeats 32 times>}}, num = 0, pos = {1068014156, 1050874984, 1075088149,

jiazhihao commented 4 years ago

The failure should have been fixed by commit c76ee70