search

VeriSilicon / TIM-VX

VeriSilicon Tensor Interface Module
Other
226 stars 84 forks source link

Is there the way to deal with graph verification errors? #24

Closed janoslim closed 3 years ago

janoslim commented 3 years ago

Hello, I am using tim-vx for tensorflow lite delegate and tengine, And I encountered graph verification fail error. What can I try to do for verification error? what may I check for this error Thank you!

thezha commented 3 years ago

Please enable the following environment variables during runtime, and post full logs here.

export VSI_NN_LOG_LEVEL=5

janoslim commented 3 years ago

Thank you. Is there another way to check verification error? I cannot get some reason of failing verification from printed logs. I tried Tengine & tflite vx-delegate both with mobilenet-v2 quantized model provided by official tensorflow.

`D [setup_node:440]Setup node id[0] uid[1] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 18] vtl[0] const[0] shape[ 224, 224, 3, 1 ] fmt[u8 ] qnt[ASM zp=128, scale=0.007874] D [print_tensor:139]in(1) : id[ 20] vtl[0] const[1] shape[ 3, 3, 3, 48 ] fmt[u8 ] qnt[ASM zp=143, scale=0.044000] D [print_tensor:139]in(2) : id[ 19] vtl[0] const[1] shape[ 48 ] fmt[i32] qnt[ASM zp= 0, scale=0.000346] D [print_tensor:139]out(0): id[ 22] vtl[2] const[0] shape[ 112, 112, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[1] uid[2] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 22] vtl[2] const[0] shape[ 112, 112, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 1] vtl[0] const[1] shape[ 3, 3, 48, 1 ] fmt[u8 ] qnt[ASM zp= 95, scale=0.464792] D [print_tensor:139]in(2) : id[ 21] vtl[0] const[1] shape[ 48 ] fmt[i32] qnt[ASM zp= 0, scale=0.010936] D [print_tensor:139]out(0): id[ 24] vtl[2] const[0] shape[ 112, 112, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[2] uid[3] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 24] vtl[2] const[0] shape[ 112, 112, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 25] vtl[0] const[1] shape[ 1, 1, 48, 24 ] fmt[u8 ] qnt[ASM zp=181, scale=0.046941] D [print_tensor:139]in(2) : id[ 23] vtl[0] const[1] shape[ 24 ] fmt[i32] qnt[ASM zp= 0, scale=0.001104] D [print_tensor:139]out(0): id[ 27] vtl[2] const[0] shape[ 112, 112, 24, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[3] uid[4] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 27] vtl[2] const[0] shape[ 112, 112, 24, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 28] vtl[0] const[1] shape[ 1, 1, 24, 144 ] fmt[u8 ] qnt[ASM zp=142, scale=0.003489] D [print_tensor:139]in(2) : id[ 26] vtl[0] const[1] shape[ 144 ] fmt[i32] qnt[ASM zp= 0, scale=0.000082] D [print_tensor:139]out(0): id[ 29] vtl[2] const[0] shape[ 112, 112, 144, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[4] uid[5] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 29] vtl[2] const[0] shape[ 112, 112, 144, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 2] vtl[0] const[1] shape[ 3, 3, 144, 1 ] fmt[u8 ] qnt[ASM zp=102, scale=0.156281] D [print_tensor:139]in(2) : id[ 30] vtl[0] const[1] shape[ 144 ] fmt[i32] qnt[ASM zp= 0, scale=0.003677] D [print_tensor:139]out(0): id[ 32] vtl[2] const[0] shape[ 56, 56, 144, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[5] uid[6] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 32] vtl[2] const[0] shape[ 56, 56, 144, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 33] vtl[0] const[1] shape[ 1, 1, 144, 32 ] fmt[u8 ] qnt[ASM zp=134, scale=0.023077] D [print_tensor:139]in(2) : id[ 31] vtl[0] const[1] shape[ 32 ] fmt[i32] qnt[ASM zp= 0, scale=0.000543] D [print_tensor:139]out(0): id[ 35] vtl[2] const[0] shape[ 56, 56, 32, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[6] uid[7] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 35] vtl[2] const[0] shape[ 56, 56, 32, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 36] vtl[0] const[1] shape[ 1, 1, 32, 192 ] fmt[u8 ] qnt[ASM zp=101, scale=0.002861] D [print_tensor:139]in(2) : id[ 34] vtl[0] const[1] shape[ 192 ] fmt[i32] qnt[ASM zp= 0, scale=0.000067] D [print_tensor:139]out(0): id[ 37] vtl[2] const[0] shape[ 56, 56, 192, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[7] uid[8] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 37] vtl[2] const[0] shape[ 56, 56, 192, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 3] vtl[0] const[1] shape[ 3, 3, 192, 1 ] fmt[u8 ] qnt[ASM zp=112, scale=0.056153] D [print_tensor:139]in(2) : id[ 38] vtl[0] const[1] shape[ 192 ] fmt[i32] qnt[ASM zp= 0, scale=0.001321] D [print_tensor:139]out(0): id[ 40] vtl[2] const[0] shape[ 56, 56, 192, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[8] uid[9] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 40] vtl[2] const[0] shape[ 56, 56, 192, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 41] vtl[0] const[1] shape[ 1, 1, 192, 32 ] fmt[u8 ] qnt[ASM zp=113, scale=0.023448] D [print_tensor:139]in(2) : id[ 39] vtl[0] const[1] shape[ 32 ] fmt[i32] qnt[ASM zp= 0, scale=0.000552] D [print_tensor:139]out(0): id[ 42] vtl[2] const[0] shape[ 56, 56, 32, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[9] uid[10] op[ADD] D [validate_op_io_types:165]Validate [ADD] D [print_tensor:139]in(0) : id[ 42] vtl[2] const[0] shape[ 56, 56, 32, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 35] vtl[2] const[0] shape[ 56, 56, 32, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 44] vtl[2] const[0] shape[ 56, 56, 32, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[10] uid[11] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 44] vtl[2] const[0] shape[ 56, 56, 32, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 45] vtl[0] const[1] shape[ 1, 1, 32, 192 ] fmt[u8 ] qnt[ASM zp=111, scale=0.003140] D [print_tensor:139]in(2) : id[ 43] vtl[0] const[1] shape[ 192 ] fmt[i32] qnt[ASM zp= 0, scale=0.000074] D [print_tensor:139]out(0): id[ 46] vtl[2] const[0] shape[ 56, 56, 192, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[11] uid[12] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 46] vtl[2] const[0] shape[ 56, 56, 192, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 4] vtl[0] const[1] shape[ 3, 3, 192, 1 ] fmt[u8 ] qnt[ASM zp=130, scale=0.017781] D [print_tensor:139]in(2) : id[ 47] vtl[0] const[1] shape[ 192 ] fmt[i32] qnt[ASM zp= 0, scale=0.000418] D [print_tensor:139]out(0): id[ 49] vtl[2] const[0] shape[ 28, 28, 192, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[12] uid[13] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 49] vtl[2] const[0] shape[ 28, 28, 192, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 50] vtl[0] const[1] shape[ 1, 1, 192, 48 ] fmt[u8 ] qnt[ASM zp=127, scale=0.013914] D [print_tensor:139]in(2) : id[ 48] vtl[0] const[1] shape[ 48 ] fmt[i32] qnt[ASM zp= 0, scale=0.000327] D [print_tensor:139]out(0): id[ 52] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[13] uid[14] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 52] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 53] vtl[0] const[1] shape[ 1, 1, 48, 288 ] fmt[u8 ] qnt[ASM zp= 96, scale=0.002891] D [print_tensor:139]in(2) : id[ 51] vtl[0] const[1] shape[ 288 ] fmt[i32] qnt[ASM zp= 0, scale=0.000068] D [print_tensor:139]out(0): id[ 54] vtl[2] const[0] shape[ 28, 28, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[14] uid[15] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 54] vtl[2] const[0] shape[ 28, 28, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 5] vtl[0] const[1] shape[ 3, 3, 288, 1 ] fmt[u8 ] qnt[ASM zp= 37, scale=0.149713] D [print_tensor:139]in(2) : id[ 55] vtl[0] const[1] shape[ 288 ] fmt[i32] qnt[ASM zp= 0, scale=0.003523] D [print_tensor:139]out(0): id[ 57] vtl[2] const[0] shape[ 28, 28, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[15] uid[16] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 57] vtl[2] const[0] shape[ 28, 28, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 58] vtl[0] const[1] shape[ 1, 1, 288, 48 ] fmt[u8 ] qnt[ASM zp=118, scale=0.013132] D [print_tensor:139]in(2) : id[ 56] vtl[0] const[1] shape[ 48 ] fmt[i32] qnt[ASM zp= 0, scale=0.000309] D [print_tensor:139]out(0): id[ 59] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[16] uid[17] op[ADD] D [validate_op_io_types:165]Validate [ADD] D [print_tensor:139]in(0) : id[ 59] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 52] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 61] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[17] uid[18] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 61] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 62] vtl[0] const[1] shape[ 1, 1, 48, 288 ] fmt[u8 ] qnt[ASM zp=128, scale=0.001644] D [print_tensor:139]in(2) : id[ 60] vtl[0] const[1] shape[ 288 ] fmt[i32] qnt[ASM zp= 0, scale=0.000039] D [print_tensor:139]out(0): id[ 63] vtl[2] const[0] shape[ 28, 28, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[18] uid[19] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 63] vtl[2] const[0] shape[ 28, 28, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 6] vtl[0] const[1] shape[ 3, 3, 288, 1 ] fmt[u8 ] qnt[ASM zp=113, scale=0.048179] D [print_tensor:139]in(2) : id[ 64] vtl[0] const[1] shape[ 288 ] fmt[i32] qnt[ASM zp= 0, scale=0.001134] D [print_tensor:139]out(0): id[ 66] vtl[2] const[0] shape[ 28, 28, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[19] uid[20] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 66] vtl[2] const[0] shape[ 28, 28, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 67] vtl[0] const[1] shape[ 1, 1, 288, 48 ] fmt[u8 ] qnt[ASM zp=114, scale=0.016087] D [print_tensor:139]in(2) : id[ 65] vtl[0] const[1] shape[ 48 ] fmt[i32] qnt[ASM zp= 0, scale=0.000379] D [print_tensor:139]out(0): id[ 68] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[20] uid[21] op[ADD] D [validate_op_io_types:165]Validate [ADD] D [print_tensor:139]in(0) : id[ 68] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 61] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 70] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[21] uid[22] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 70] vtl[2] const[0] shape[ 28, 28, 48, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 71] vtl[0] const[1] shape[ 1, 1, 48, 288 ] fmt[u8 ] qnt[ASM zp=122, scale=0.002326] D [print_tensor:139]in(2) : id[ 69] vtl[0] const[1] shape[ 288 ] fmt[i32] qnt[ASM zp= 0, scale=0.000055] D [print_tensor:139]out(0): id[ 72] vtl[2] const[0] shape[ 28, 28, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[22] uid[23] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 72] vtl[2] const[0] shape[ 28, 28, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 7] vtl[0] const[1] shape[ 3, 3, 288, 1 ] fmt[u8 ] qnt[ASM zp=105, scale=0.034582] D [print_tensor:139]in(2) : id[ 73] vtl[0] const[1] shape[ 288 ] fmt[i32] qnt[ASM zp= 0, scale=0.000814] D [print_tensor:139]out(0): id[ 75] vtl[2] const[0] shape[ 14, 14, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[23] uid[24] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 75] vtl[2] const[0] shape[ 14, 14, 288, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 76] vtl[0] const[1] shape[ 1, 1, 288, 88 ] fmt[u8 ] qnt[ASM zp=135, scale=0.011330] D [print_tensor:139]in(2) : id[ 74] vtl[0] const[1] shape[ 88 ] fmt[i32] qnt[ASM zp= 0, scale=0.000267] D [print_tensor:139]out(0): id[ 78] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[24] uid[25] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 78] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 79] vtl[0] const[1] shape[ 1, 1, 88, 528 ] fmt[u8 ] qnt[ASM zp=144, scale=0.001648] D [print_tensor:139]in(2) : id[ 77] vtl[0] const[1] shape[ 528 ] fmt[i32] qnt[ASM zp= 0, scale=0.000039] D [print_tensor:139]out(0): id[ 80] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[25] uid[26] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 80] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 8] vtl[0] const[1] shape[ 3, 3, 528, 1 ] fmt[u8 ] qnt[ASM zp=154, scale=0.110969] D [print_tensor:139]in(2) : id[ 81] vtl[0] const[1] shape[ 528 ] fmt[i32] qnt[ASM zp= 0, scale=0.002611] D [print_tensor:139]out(0): id[ 83] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[26] uid[27] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 83] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 84] vtl[0] const[1] shape[ 1, 1, 528, 88 ] fmt[u8 ] qnt[ASM zp=144, scale=0.015020] D [print_tensor:139]in(2) : id[ 82] vtl[0] const[1] shape[ 88 ] fmt[i32] qnt[ASM zp= 0, scale=0.000353] D [print_tensor:139]out(0): id[ 85] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[27] uid[28] op[ADD] D [validate_op_io_types:165]Validate [ADD] D [print_tensor:139]in(0) : id[ 85] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 78] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 87] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[28] uid[29] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 87] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 88] vtl[0] const[1] shape[ 1, 1, 88, 528 ] fmt[u8 ] qnt[ASM zp=129, scale=0.001483] D [print_tensor:139]in(2) : id[ 86] vtl[0] const[1] shape[ 528 ] fmt[i32] qnt[ASM zp= 0, scale=0.000035] D [print_tensor:139]out(0): id[ 89] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[29] uid[30] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 89] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 9] vtl[0] const[1] shape[ 3, 3, 528, 1 ] fmt[u8 ] qnt[ASM zp=139, scale=0.038755] D [print_tensor:139]in(2) : id[ 90] vtl[0] const[1] shape[ 528 ] fmt[i32] qnt[ASM zp= 0, scale=0.000912] D [print_tensor:139]out(0): id[ 92] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[30] uid[31] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 92] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 93] vtl[0] const[1] shape[ 1, 1, 528, 88 ] fmt[u8 ] qnt[ASM zp=122, scale=0.013249] D [print_tensor:139]in(2) : id[ 91] vtl[0] const[1] shape[ 88 ] fmt[i32] qnt[ASM zp= 0, scale=0.000312] D [print_tensor:139]out(0): id[ 94] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[31] uid[32] op[ADD] D [validate_op_io_types:165]Validate [ADD] D [print_tensor:139]in(0) : id[ 94] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 87] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 96] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[32] uid[33] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 96] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 97] vtl[0] const[1] shape[ 1, 1, 88, 528 ] fmt[u8 ] qnt[ASM zp=117, scale=0.001335] D [print_tensor:139]in(2) : id[ 95] vtl[0] const[1] shape[ 528 ] fmt[i32] qnt[ASM zp= 0, scale=0.000031] D [print_tensor:139]out(0): id[ 98] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[33] uid[34] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 98] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 10] vtl[0] const[1] shape[ 3, 3, 528, 1 ] fmt[u8 ] qnt[ASM zp=146, scale=0.035498] D [print_tensor:139]in(2) : id[ 99] vtl[0] const[1] shape[ 528 ] fmt[i32] qnt[ASM zp= 0, scale=0.000835] D [print_tensor:139]out(0): id[ 101] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[34] uid[35] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 101] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 102] vtl[0] const[1] shape[ 1, 1, 528, 88 ] fmt[u8 ] qnt[ASM zp=137, scale=0.013165] D [print_tensor:139]in(2) : id[ 100] vtl[0] const[1] shape[ 88 ] fmt[i32] qnt[ASM zp= 0, scale=0.000310] D [print_tensor:139]out(0): id[ 103] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[35] uid[36] op[ADD] D [validate_op_io_types:165]Validate [ADD] D [print_tensor:139]in(0) : id[ 103] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 96] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 104] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[36] uid[37] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 104] vtl[2] const[0] shape[ 14, 14, 88, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 106] vtl[0] const[1] shape[ 1, 1, 88, 528 ] fmt[u8 ] qnt[ASM zp=147, scale=0.001861] D [print_tensor:139]in(2) : id[ 105] vtl[0] const[1] shape[ 528 ] fmt[i32] qnt[ASM zp= 0, scale=0.000044] D [print_tensor:139]out(0): id[ 107] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[37] uid[38] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 107] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 11] vtl[0] const[1] shape[ 3, 3, 528, 1 ] fmt[u8 ] qnt[ASM zp=155, scale=0.030437] D [print_tensor:139]in(2) : id[ 108] vtl[0] const[1] shape[ 528 ] fmt[i32] qnt[ASM zp= 0, scale=0.000716] D [print_tensor:139]out(0): id[ 110] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[38] uid[39] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 110] vtl[2] const[0] shape[ 14, 14, 528, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 111] vtl[0] const[1] shape[ 1, 1, 528, 136 ] fmt[u8 ] qnt[ASM zp=121, scale=0.005562] D [print_tensor:139]in(2) : id[ 109] vtl[0] const[1] shape[ 136 ] fmt[i32] qnt[ASM zp= 0, scale=0.000131] D [print_tensor:139]out(0): id[ 113] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[39] uid[40] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 113] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 114] vtl[0] const[1] shape[ 1, 1, 136, 816 ] fmt[u8 ] qnt[ASM zp=134, scale=0.002319] D [print_tensor:139]in(2) : id[ 112] vtl[0] const[1] shape[ 816 ] fmt[i32] qnt[ASM zp= 0, scale=0.000055] D [print_tensor:139]out(0): id[ 115] vtl[2] const[0] shape[ 14, 14, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[40] uid[41] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 115] vtl[2] const[0] shape[ 14, 14, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 12] vtl[0] const[1] shape[ 3, 3, 816, 1 ] fmt[u8 ] qnt[ASM zp=161, scale=0.094060] D [print_tensor:139]in(2) : id[ 116] vtl[0] const[1] shape[ 816 ] fmt[i32] qnt[ASM zp= 0, scale=0.002213] D [print_tensor:139]out(0): id[ 118] vtl[2] const[0] shape[ 14, 14, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[41] uid[42] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 118] vtl[2] const[0] shape[ 14, 14, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 119] vtl[0] const[1] shape[ 1, 1, 816, 136 ] fmt[u8 ] qnt[ASM zp=124, scale=0.007079] D [print_tensor:139]in(2) : id[ 117] vtl[0] const[1] shape[ 136 ] fmt[i32] qnt[ASM zp= 0, scale=0.000167] D [print_tensor:139]out(0): id[ 120] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[42] uid[43] op[ADD] D [validate_op_io_types:165]Validate [ADD] D [print_tensor:139]in(0) : id[ 120] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 113] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 122] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[43] uid[44] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 122] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 123] vtl[0] const[1] shape[ 1, 1, 136, 816 ] fmt[u8 ] qnt[ASM zp=119, scale=0.001318] D [print_tensor:139]in(2) : id[ 121] vtl[0] const[1] shape[ 816 ] fmt[i32] qnt[ASM zp= 0, scale=0.000031] D [print_tensor:139]out(0): id[ 124] vtl[2] const[0] shape[ 14, 14, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[44] uid[45] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 124] vtl[2] const[0] shape[ 14, 14, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 13] vtl[0] const[1] shape[ 3, 3, 816, 1 ] fmt[u8 ] qnt[ASM zp= 94, scale=0.080346] D [print_tensor:139]in(2) : id[ 125] vtl[0] const[1] shape[ 816 ] fmt[i32] qnt[ASM zp= 0, scale=0.001890] D [print_tensor:139]out(0): id[ 127] vtl[2] const[0] shape[ 14, 14, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[45] uid[46] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 127] vtl[2] const[0] shape[ 14, 14, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 128] vtl[0] const[1] shape[ 1, 1, 816, 136 ] fmt[u8 ] qnt[ASM zp=129, scale=0.019790] D [print_tensor:139]in(2) : id[ 126] vtl[0] const[1] shape[ 136 ] fmt[i32] qnt[ASM zp= 0, scale=0.000466] D [print_tensor:139]out(0): id[ 129] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[46] uid[47] op[ADD] D [validate_op_io_types:165]Validate [ADD] D [print_tensor:139]in(0) : id[ 129] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 122] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 131] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[47] uid[48] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 131] vtl[2] const[0] shape[ 14, 14, 136, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 132] vtl[0] const[1] shape[ 1, 1, 136, 816 ] fmt[u8 ] qnt[ASM zp=120, scale=0.001781] D [print_tensor:139]in(2) : id[ 130] vtl[0] const[1] shape[ 816 ] fmt[i32] qnt[ASM zp= 0, scale=0.000042] D [print_tensor:139]out(0): id[ 133] vtl[2] const[0] shape[ 14, 14, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[48] uid[49] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 133] vtl[2] const[0] shape[ 14, 14, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 14] vtl[0] const[1] shape[ 3, 3, 816, 1 ] fmt[u8 ] qnt[ASM zp=129, scale=0.012976] D [print_tensor:139]in(2) : id[ 134] vtl[0] const[1] shape[ 816 ] fmt[i32] qnt[ASM zp= 0, scale=0.000305] D [print_tensor:139]out(0): id[ 136] vtl[2] const[0] shape[ 7, 7, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[49] uid[50] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 136] vtl[2] const[0] shape[ 7, 7, 816, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 137] vtl[0] const[1] shape[ 1, 1, 816, 224 ] fmt[u8 ] qnt[ASM zp=115, scale=0.011227] D [print_tensor:139]in(2) : id[ 135] vtl[0] const[1] shape[ 224 ] fmt[i32] qnt[ASM zp= 0, scale=0.000264] D [print_tensor:139]out(0): id[ 139] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[50] uid[51] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 139] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 140] vtl[0] const[1] shape[ 1, 1, 224, 1344 ] fmt[u8 ] qnt[ASM zp=119, scale=0.002037] D [print_tensor:139]in(2) : id[ 138] vtl[0] const[1] shape[ 1344 ] fmt[i32] qnt[ASM zp= 0, scale=0.000048] D [print_tensor:139]out(0): id[ 141] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[51] uid[52] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 141] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 15] vtl[0] const[1] shape[ 3, 3, 1344, 1 ] fmt[u8 ] qnt[ASM zp=120, scale=0.052825] D [print_tensor:139]in(2) : id[ 142] vtl[0] const[1] shape[ 1344 ] fmt[i32] qnt[ASM zp= 0, scale=0.001243] D [print_tensor:139]out(0): id[ 144] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[52] uid[53] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 144] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 145] vtl[0] const[1] shape[ 1, 1, 1344, 224 ] fmt[u8 ] qnt[ASM zp=135, scale=0.008515] D [print_tensor:139]in(2) : id[ 143] vtl[0] const[1] shape[ 224 ] fmt[i32] qnt[ASM zp= 0, scale=0.000200] D [print_tensor:139]out(0): id[ 146] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[53] uid[54] op[ADD] D [validate_op_io_types:165]Validate [ADD] D [print_tensor:139]in(0) : id[ 146] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 139] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 148] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[54] uid[55] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 148] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 149] vtl[0] const[1] shape[ 1, 1, 224, 1344 ] fmt[u8 ] qnt[ASM zp=143, scale=0.001751] D [print_tensor:139]in(2) : id[ 147] vtl[0] const[1] shape[ 1344 ] fmt[i32] qnt[ASM zp= 0, scale=0.000041] D [print_tensor:139]out(0): id[ 150] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[55] uid[56] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 150] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 16] vtl[0] const[1] shape[ 3, 3, 1344, 1 ] fmt[u8 ] qnt[ASM zp=127, scale=0.065242] D [print_tensor:139]in(2) : id[ 151] vtl[0] const[1] shape[ 1344 ] fmt[i32] qnt[ASM zp= 0, scale=0.001535] D [print_tensor:139]out(0): id[ 153] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[56] uid[57] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 153] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 154] vtl[0] const[1] shape[ 1, 1, 1344, 224 ] fmt[u8 ] qnt[ASM zp=117, scale=0.033019] D [print_tensor:139]in(2) : id[ 152] vtl[0] const[1] shape[ 224 ] fmt[i32] qnt[ASM zp= 0, scale=0.000777] D [print_tensor:139]out(0): id[ 155] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[57] uid[58] op[ADD] D [validate_op_io_types:165]Validate [ADD] D [print_tensor:139]in(0) : id[ 155] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 148] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 157] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[58] uid[59] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 157] vtl[2] const[0] shape[ 7, 7, 224, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 158] vtl[0] const[1] shape[ 1, 1, 224, 1344 ] fmt[u8 ] qnt[ASM zp=134, scale=0.002581] D [print_tensor:139]in(2) : id[ 156] vtl[0] const[1] shape[ 1344 ] fmt[i32] qnt[ASM zp= 0, scale=0.000061] D [print_tensor:139]out(0): id[ 159] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[59] uid[60] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 159] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 17] vtl[0] const[1] shape[ 3, 3, 1344, 1 ] fmt[u8 ] qnt[ASM zp=199, scale=0.158337] D [print_tensor:139]in(2) : id[ 160] vtl[0] const[1] shape[ 1344 ] fmt[i32] qnt[ASM zp= 0, scale=0.003726] D [print_tensor:139]out(0): id[ 162] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[60] uid[61] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 162] vtl[2] const[0] shape[ 7, 7, 1344, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 163] vtl[0] const[1] shape[ 1, 1, 1344, 448 ] fmt[u8 ] qnt[ASM zp=145, scale=0.006616] D [print_tensor:139]in(2) : id[ 161] vtl[0] const[1] shape[ 448 ] fmt[i32] qnt[ASM zp= 0, scale=0.000156] D [print_tensor:139]out(0): id[ 164] vtl[2] const[0] shape[ 7, 7, 448, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[61] uid[62] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 164] vtl[2] const[0] shape[ 7, 7, 448, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 166] vtl[0] const[1] shape[ 1, 1, 448, 1792 ] fmt[u8 ] qnt[ASM zp=135, scale=0.005028] D [print_tensor:139]in(2) : id[ 165] vtl[0] const[1] shape[ 1792 ] fmt[i32] qnt[ASM zp= 0, scale=0.000118] D [print_tensor:139]out(0): id[ 167] vtl[2] const[0] shape[ 7, 7, 1792, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[62] uid[63] op[POOL] D [validate_op_io_types:165]Validate [POOL] D [print_tensor:139]in(0) : id[ 167] vtl[2] const[0] shape[ 7, 7, 1792, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]out(0): id[ 169] vtl[2] const[0] shape[ 1, 1, 1792, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [setup_node:440]Setup node id[63] uid[64] op[CONV2D] D [validate_op_io_types:165]Validate [CONV2D] D [print_tensor:139]in(0) : id[ 169] vtl[2] const[0] shape[ 1, 1, 1792, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [print_tensor:139]in(1) : id[ 170] vtl[0] const[1] shape[ 1, 1, 1792, 1001 ] fmt[u8 ] qnt[ASM zp=106, scale=0.001523] D [print_tensor:139]in(2) : id[ 168] vtl[0] const[1] shape[ 1001 ] fmt[i32] qnt[ASM zp= 0, scale=0.000036] D [print_tensor:139]out(0): id[ 0] vtl[0] const[0] shape[ 1, 1, 1001, 1 ] fmt[u8 ] qnt[ASM zp= 0, scale=0.023529] D [optimize_node:385]Backward optimize neural network D [optimize_node:392]Forward optimize neural network I [compute_node:327]Create vx node D [compute_node:350]Instance node[0] "CONV2D" ... D [compute_node:350]Instance node[1] "CONV2D" ... D [compute_node:350]Instance node[2] "CONV2D" ... D [compute_node:350]Instance node[3] "CONV2D" ... D [compute_node:350]Instance node[4] "CONV2D" ... D [compute_node:350]Instance node[5] "CONV2D" ... D [compute_node:350]Instance node[6] "CONV2D" ... D [compute_node:350]Instance node[7] "CONV2D" ... D [compute_node:350]Instance node[8] "CONV2D" ... D [compute_node:350]Instance node[9] "ADD" ... D [vsi_nn_kernel_selector:969]Instance OPENVX node with kernel "add" D [compute_node:350]Instance node[10] "CONV2D" ... D [compute_node:350]Instance node[11] "CONV2D" ... D [compute_node:350]Instance node[12] "CONV2D" ... D [compute_node:350]Instance node[13] "CONV2D" ... D [compute_node:350]Instance node[14] "CONV2D" ... D [compute_node:350]Instance node[15] "CONV2D" ... D [compute_node:350]Instance node[16] "ADD" ... D [vsi_nn_kernel_selector:969]Instance OPENVX node with kernel "add" D [compute_node:350]Instance node[17] "CONV2D" ... D [compute_node:350]Instance node[18] "CONV2D" ... D [compute_node:350]Instance node[19] "CONV2D" ... D [compute_node:350]Instance node[20] "ADD" ... D [vsi_nn_kernel_selector:969]Instance OPENVX node with kernel "add" D [compute_node:350]Instance node[21] "CONV2D" ... D [compute_node:350]Instance node[22] "CONV2D" ... D [compute_node:350]Instance node[23] "CONV2D" ... D [compute_node:350]Instance node[24] "CONV2D" ... D [compute_node:350]Instance node[25] "CONV2D" ... D [compute_node:350]Instance node[26] "CONV2D" ... D [compute_node:350]Instance node[27] "ADD" ... D [vsi_nn_kernel_selector:969]Instance OPENVX node with kernel "add" D [compute_node:350]Instance node[28] "CONV2D" ... D [compute_node:350]Instance node[29] "CONV2D" ... D [compute_node:350]Instance node[30] "CONV2D" ... D [compute_node:350]Instance node[31] "ADD" ... D [vsi_nn_kernel_selector:969]Instance OPENVX node with kernel "add" D [compute_node:350]Instance node[32] "CONV2D" ... D [compute_node:350]Instance node[33] "CONV2D" ... D [compute_node:350]Instance node[34] "CONV2D" ... D [compute_node:350]Instance node[35] "ADD" ... D [vsi_nn_kernel_selector:969]Instance OPENVX node with kernel "add" D [compute_node:350]Instance node[36] "CONV2D" ... D [compute_node:350]Instance node[37] "CONV2D" ... D [compute_node:350]Instance node[38] "CONV2D" ... D [compute_node:350]Instance node[39] "CONV2D" ... D [compute_node:350]Instance node[40] "CONV2D" ... D [compute_node:350]Instance node[41] "CONV2D" ... D [compute_node:350]Instance node[42] "ADD" ... D [vsi_nn_kernel_selector:969]Instance OPENVX node with kernel "add" D [compute_node:350]Instance node[43] "CONV2D" ... D [compute_node:350]Instance node[44] "CONV2D" ... D [compute_node:350]Instance node[45] "CONV2D" ... D [compute_node:350]Instance node[46] "ADD" ... D [vsi_nn_kernel_selector:969]Instance OPENVX node with kernel "add" D [compute_node:350]Instance node[47] "CONV2D" ... D [compute_node:350]Instance node[48] "CONV2D" ... D [compute_node:350]Instance node[49] "CONV2D" ... D [compute_node:350]Instance node[50] "CONV2D" ... D [compute_node:350]Instance node[51] "CONV2D" ... D [compute_node:350]Instance node[52] "CONV2D" ... D [compute_node:350]Instance node[53] "ADD" ... D [vsi_nn_kernel_selector:969]Instance OPENVX node with kernel "add" D [compute_node:350]Instance node[54] "CONV2D" ... D [compute_node:350]Instance node[55] "CONV2D" ... D [compute_node:350]Instance node[56] "CONV2D" ... D [compute_node:350]Instance node[57] "ADD" ... D [vsi_nn_kernel_selector:969]Instance OPENVX node with kernel "add" D [compute_node:350]Instance node[58] "CONV2D" ... D [compute_node:350]Instance node[59] "CONV2D" ... D [compute_node:350]Instance node[60] "CONV2D" ... D [compute_node:350]Instance node[61] "CONV2D" ... D [compute_node:350]Instance node[62] "POOL" ... D [compute_node:350]Instance node[63] "CONV2D" ...

Compile graph fail. `

thezha commented 3 years ago

Did you set export VIVANTE_SDK_DIR to point to the SDK path at runtime?

janoslim commented 3 years ago

No I don't set VIVANTE_SDK_DIR but another models works well like vgg. And What is the sdk path you are said ? I am using libtim-vx.so. Could this be a version issue for openVX library for vim3? Then where can I find another version of the library

Thank you.

thezha commented 3 years ago

Some networks require runtime compilation to happen on device, and you need to point VIVANTE_SDK_DIR to the location of the pre-built SDK which you pushed onto the device. In my environment, it looks like something below. 

root@Khadas:/home/kainan/vx_delegate/vim3_aarch64# pwd
/home/kainan/vx_delegate/vim3_aarch64
root@Khadas:/home/kainan/vx_delegate/vim3_aarch64# tree -L 2
.
├── include
│   ├── CL
│   └── VX
└── lib
    ├── galcore.ko
    ├── libArchModelSw.so
    ├── libCLC.so
    ├── libGAL.so
    ├── libNNArchPerf.so
    ├── libNNGPUBinary.so
    ├── libNNVXCBinary.so
    ├── libOpenVXC.so
    ├── libOpenVX.so -> libOpenVX.so.1.3.0
    ├── libOpenVX.so.1 -> libOpenVX.so.1.3.0
    ├── libOpenVX.so.1.3.0
    ├── libOpenVXU.so
    ├── libOvx12VXCBinary.so
    └── libVSC.so

4 directories, 14 files
root@Khadas:/home/kainan/vx_delegate/vim3_aarch64# export | grep VIVANTE_SDK_DIR
declare -x VIVANTE_SDK_DIR="/home/kainan/vx_delegate/vim3_aarch64"
janoslim commented 3 years ago

still same issues :( Could you check if I upload the tflite models that causes problems?

tflite_quant_models.zip

Thank you alot.

thezha commented 3 years ago

I can run all three of this models fine. Did you copy the header files over onto the device? The runtime compiler needs to look for this file, so please make sure it is present on your system.

root@Khadas:/home/kainan/vx_delegate/vim3_aarch64# ls -l include/CL/ total 76 -rw-rw-r-- 1 993 992 76691 Mar 17 16:50 cl_viv_vx_ext.h

janoslim commented 3 years ago

It's hard to find what I missed. It's not a network problem that all networks work well on your device. Did you test test them on tengine? I tried tengine and tflite-vxdelegate and they all failed.

khadas@Khadas:~/tengine-lite/3rdparty/tim-vx$ tree -L 3
.
├── include
│   ├── CL
│   │   └── cl_viv_vx_ext.h
│   ├── tim
│   │   └── vx
│   └── VX
│       ├── viv_nn_compatibility.h
│       ├── vx_api.h
│       ├── vx_compatibility.h
│       ├── vx_ext_program.h
│       ├── vx_ext_target.h
│       ├── vx.h
│       ├── vx_helper.h
│       ├── vx_kernels.h
│       ├── vx_khr_cnn.h
│       ├── vx_khr_compatible.h
│       ├── vx_khr_dot.h
│       ├── vx_khr_icd.h
│       ├── vx_khr_import_kernel.h
│       ├── vx_khr_interp.h
│       ├── vx_khr_nn.h
│       ├── vx_khr_nn_internal.h
│       ├── vx_khr_node_memory.h
│       ├── vx_khr_opencl.h
│       ├── vx_khr_tiling.h
│       ├── vx_khr_variants.h
│       ├── vx_khr_xml.h
│       ├── vx_lib_debug.h
│       ├── vx_lib_extras.h
│       ├── vx_lib_xyz.h
│       ├── vx_nodes.h
│       ├── vx_types.h
│       ├── vxu.h
│       ├── vx_vendors.h
│       └── vx_viv_sys.h
└── lib
    ├── aarch64
    ├── galcore.ko
    ├── libArchModelSw.so
    ├── libCLC.so
    ├── libGAL.so
    ├── libNNArchPerf.so
    ├── libNNGPUBinary.so
    ├── libNNVXCBinary.so
    ├── libOpenVXC.so
    ├── libOpenVX.so.1.3.0
    ├── libOpenVXU.so
    ├── libOvx12VXCBinary.so
    └── libVSC.so

7 directories, 42 files
khadas@Khadas:~$ ldd benchmark_model
        linux-vdso.so.1 (0x0000007fa77c8000)
        libArchModelSw.so => /lib/libArchModelSw.so (0x0000007fa7740000)
        libCLC.so => /lib/libCLC.so (0x0000007fa74fb000)
        libGAL.so => /lib/libGAL.so (0x0000007fa7333000)
        libNNArchPerf.so => /lib/libNNArchPerf.so (0x0000007fa72f0000)
        libNNGPUBinary.so => /lib/libNNGPUBinary.so (0x0000007fa670a000)
        libNNVXCBinary.so => /lib/libNNVXCBinary.so (0x0000007fa378e000)
        libOpenVX.so.1 => /lib/libOpenVX.so.1 (0x0000007fa3586000)
        libOpenVXC.so => /lib/libOpenVXC.so (0x0000007fa356a000)
        libOpenVXU.so => /lib/libOpenVXU.so (0x0000007fa3553000)
        libOvx12VXCBinary.so => /lib/libOvx12VXCBinary.so (0x0000007fa316a000)
        libVSC.so => /lib/libVSC.so (0x0000007fa222e000)
        libm.so.6 => /lib/aarch64-linux-gnu/libm.so.6 (0x0000007fa2181000)
        libdl.so.2 => /lib/aarch64-linux-gnu/libdl.so.2 (0x0000007fa216d000)
        libpthread.so.0 => /lib/aarch64-linux-gnu/libpthread.so.0 (0x0000007fa213d000)
        librt.so.1 => /lib/aarch64-linux-gnu/librt.so.1 (0x0000007fa2125000)
        libstdc++.so.6 => /lib/aarch64-linux-gnu/libstdc++.so.6 (0x0000007fa1f42000)
        libgcc_s.so.1 => /lib/aarch64-linux-gnu/libgcc_s.so.1 (0x0000007fa1f1d000)
        libc.so.6 => /lib/aarch64-linux-gnu/libc.so.6 (0x0000007fa1daa000)
        /lib/ld-linux-aarch64.so.1 (0x0000007fa7798000)
thezha commented 3 years ago

It seems that ldd found these libraries in /lib, but your libraries are in ~/tengine-lite/3rdparty/tim-vx/lib

janoslim commented 3 years ago

I push them both ~/tengine-lite/3rdparty/tim-vx/lib and /lib. Does this can make the problem? However if it is the library error, every model would not works well but my vgg19 model works fine.

janoslim commented 3 years ago

I fixed with os reset. thank you for your response.