Tencent / TNN

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
Other
4.42k stars 771 forks source link

benchmark在安卓端跑性能测试失败 #1109

Closed bestpower closed 3 years ago

bestpower commented 3 years ago

1. 环境(environment)

WORK_DIR=pwd BENCHMARK_MODEL_DIR=$WORK_DIR/../benchmark-model BUILD_DIR=build BUILD_APP_DIR=build_app ANDROID_DIR=/data/local/tmp/tnn-benchmark ANDROID_DATA_DIR=$ANDROID_DIR/benchmark-model OUTPUT_LOG_FILE=benchmark_models_result.txt LOOP_COUNT=100 WARM_UP_COUNT=10 INTERVAL=5

4. 编译日志(build log) 模型转换日志: ---------- convert model, please wait a moment ----------

Converter ONNX to TNN Model...

Converter ONNX to TNN check_onnx_dim...

Converter ONNX to TNN check_onnx_dim...

Converter ONNX to TNN model succeed!

benchmark混合脚本编译日志: -- android-14 is unsupported. Using minimum supported version 16. -- Check for working C compiler: /home/wyu/SDK/NDK/android-ndk-r19c/toolchains/llvm/prebuilt/linux-x86_64/bin/clang -- Check for working C compiler: /home/wyu/SDK/NDK/android-ndk-r19c/toolchains/llvm/prebuilt/linux-x86_64/bin/clang -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Detecting C compile features -- Detecting C compile features - done -- Check for working CXX compiler: /home/wyu/SDK/NDK/android-ndk-r19c/toolchains/llvm/prebuilt/linux-x86_64/bin/clang++ -- Check for working CXX compiler: /home/wyu/SDK/NDK/android-ndk-r19c/toolchains/llvm/prebuilt/linux-x86_64/bin/clang++ -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Detecting CXX compile features -- Detecting CXX compile features - done -- The ASM compiler identification is Clang -- Found assembler: /home/wyu/SDK/NDK/android-ndk-r19c/toolchains/llvm/prebuilt/linux-x86_64/bin/clang /home/wyu/github_projects/TNN /home/wyu/github_projects/TNN -- Found OpenMP_C: -fopenmp=libomp (found version "3.1") -- Found OpenMP_CXX: -fopenmp=libomp (found version "3.1") -- Found OpenMP: TRUE (found version "3.1")
-- >>>>>>>>>>>>> -- TNN BUILD INFO: -- System: Android -- Processor: armv7-a -- Cpu: ON -- X86: OFF -- Arm: ON -- Arm82: OFF -- Metal: OFF -- OpenCL: OFF -- CUDA: OFF -- DSP: OFF -- Atlas: OFF -- TensorRT: OFF -- HuaweiNPU:
-- RKNPU: OFF -- OpenVINO: OFF -- OpenMP: ON -- TEST: ON -- --Unit Test: OFF -- Quantization: OFF -- ModelCheck: OFF -- DEBUG:
-- PROFILE: OFF -- BENCHMARK: ON -- BENCHMARK Layer: OFF -- Model Converter: OFF -- ONNX2TNN Converter: OFF -- TNN2MEM: OFF -- BENCHMARK Test Lib: ON -- Looking for C++ include unistd.h -- Looking for C++ include unistd.h - found -- Looking for C++ include stdint.h -- Looking for C++ include stdint.h - found -- Looking for C++ include inttypes.h -- Looking for C++ include inttypes.h - found -- Looking for C++ include sys/types.h -- Looking for C++ include sys/types.h - found -- Looking for C++ include sys/stat.h -- Looking for C++ include sys/stat.h - found -- Looking for C++ include fnmatch.h -- Looking for C++ include fnmatch.h - found -- Looking for C++ include stddef.h -- Looking for C++ include stddef.h - found -- Check size of uint32_t -- Check size of uint32_t - done -- Looking for strtoll -- Looking for strtoll - found -- Configuring done -- Generating done -- Build files have been written to: /home/wyu/github_projects/TNN/benchmark/benchmark_android/build Scanning dependencies of target gflags_nothreads_static Scanning dependencies of target TNNArm Scanning dependencies of target TNNCpu [ 0%] Building CXX object third_party/gflags/CMakeFiles/gflags_nothreads_static.dir/src/gflags.cc.o [ 0%] Building CXX object third_party/gflags/CMakeFiles/gflags_nothreads_static.dir/src/gflags_reporting.cc.o [ 0%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/compute/compute_elewise.cc.o [ 1%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_abs_layer_acc.cc.o [ 1%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/compute/compute_int8.cc.o [ 1%] Building CXX object third_party/gflags/CMakeFiles/gflags_nothreads_static.dir/src/gflags_completions.cc.o [ 1%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpuhistogram_layer_acc.cc.o [ 1%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_add_layer_acc.cc.o [ 1%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_arg_max_or_min_layer_acc.cc.o [ 2%] Linking CXX static library libgflags_nothreads.a [ 2%] Built target gflags_nothreads_static [ 2%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_batch_norm_layer_acc.cc.o [ 2%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_abs_layer_acc.cc.o [ 2%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_binary_layer_acc.cc.o [ 2%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_cast_layer_acc.cc.o [ 3%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_acos_layer_acc.cc.o [ 4%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_clip_layer_acc.cc.o [ 4%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_concat_layer_acc.cc.o [ 4%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_add_layer_acc.cc.o [ 4%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_detection_output_layer_acc.cc.o [ 4%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_div_layer_acc.cc.o [ 4%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_elu_layer_acc.cc.o [ 4%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_arg_max_or_min_layer_acc.cc.o [ 4%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_exp_layer_acc.cc.o [ 5%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_expand_layer_acc.cc.o [ 5%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_asin_layer_acc.cc.o [ 5%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_floor_layer_acc.cc.o [ 5%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_gather_layer_acc.cc.o [ 5%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_grid_sample_layer_acc.cc.o [ 5%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_atan_layer_acc.cc.o /home/wyu/github_projects/TNN/source/tnn/device/arm/acc/arm_grid_sample_layer_acc.cc:196:103: warning: format specifies type 'unsigned long' but the argument has type 'std::ndk1::vector<int, std::__ndk1::allocator >::size_type' (aka 'unsigned int') [-Wformat] LOGE("Error: Arm layer acc don't support GridSample input size(%lu) or param:(%d, %d, %d)\n", input_dims.size(),


                                                                       %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:103:50: note: expanded from macro 'LOGE'
#define LOGE(fmt, ...) LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__)
                             ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:90:37: note: expanded from macro 'LOGET'
                        __LINE__, ##__VA_ARGS__);                                                                      \
                                    ^~~~~~~~~~~
/home/wyu/github_projects/TNN/source/tnn/device/arm/acc/arm_grid_sample_layer_acc.cc:196:103: warning: format specifies type 'unsigned long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE("Error: Arm layer acc don't support GridSample input size(%lu) or param:(%d, %d, %d)\n", input_dims.size(),
                                                                       ~~~                            ^~~~~~~~~~~~~~~~~
                                                                       %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:103:50: note: expanded from macro 'LOGE'
#define LOGE(fmt, ...) LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__)
                             ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:91:107: note: expanded from macro 'LOGET'
    fprintf(stderr, ("E/%s: %s [File %s][Line %d] " fmt), tag, __PRETTY_FUNCTION__, __FILE__, __LINE__, ##__VA_ARGS__)
                                                    ~~~                                                   ^~~~~~~~~~~
[  5%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_hard_sigmoid_acc.cc.o
[  6%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_hard_swish_acc.cc.o
[  6%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_batch_norm_layer_acc.cc.o
2 warnings generated.
[  6%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_inner_product_layer_acc.cc.o
[  6%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_instance_norm_layer_acc.cc.o
[  7%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_bias_add_layer_acc.cc.o
[  7%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_inverse_layer_acc.cc.o
[  7%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_layer_acc.cc.o
[  7%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_log_acc_layer_acc.cc.o
[  7%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_binary_op_layer_acc.cc.o
[  8%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_log_sigmoid_layer_acc.cc.o
[  8%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_lstm_layer_acc.cc.o
[  8%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_bitshift_layer_acc.cc.o
[  8%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_mat_mul_layer_acc.cc.o
[  8%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_max_layer_acc.cc.o
[  8%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_cast_layer_acc.cc.o
[  8%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_min_layer_acc.cc.o
[  8%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_mul_layer_acc.cc.o
[  9%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_nchw_layer_acc.cc.o
[  9%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_ceil_layer_acc.cc.o
[  9%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_neg_layer_acc.cc.o
[  9%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_normalize_layer_acc.cc.o
[  9%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_clip_layer_acc.cc.o
[  9%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_pad_layer_acc.cc.o
/home/wyu/github_projects/TNN/source/tnn/device/arm/acc/arm_pad_layer_acc.cc:33:93: warning: format specifies type 'unsigned long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE("Error: ArmPadLayerAcc only support 4 dims input, but now dims size is %lu/n", input_dims.size());
                                                                                    ~~~     ^~~~~~~~~~~~~~~~~
                                                                                    %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:103:50: note: expanded from macro 'LOGE'
#define LOGE(fmt, ...) LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__)
                             ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:90:37: note: expanded from macro 'LOGET'
                        __LINE__, ##__VA_ARGS__);                                                                      \
                                    ^~~~~~~~~~~
/home/wyu/github_projects/TNN/source/tnn/device/arm/acc/arm_pad_layer_acc.cc:33:93: warning: format specifies type 'unsigned long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE("Error: ArmPadLayerAcc only support 4 dims input, but now dims size is %lu/n", input_dims.size());
                                                                                    ~~~     ^~~~~~~~~~~~~~~~~
                                                                                    %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:103:50: note: expanded from macro 'LOGE'
#define LOGE(fmt, ...) LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__)
                             ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:91:107: note: expanded from macro 'LOGET'
    fprintf(stderr, ("E/%s: %s [File %s][Line %d] " fmt), tag, __PRETTY_FUNCTION__, __FILE__, __LINE__, ##__VA_ARGS__)
                                                    ~~~                                                   ^~~~~~~~~~~
/home/wyu/github_projects/TNN/source/tnn/device/arm/acc/arm_pad_layer_acc.cc:48:81: warning: format specifies type 'unsigned long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE("Error: ArmPadLayerAcc layer acc does not support pas size %lu\n", pads.size());
                                                                        ~~~     ^~~~~~~~~~~
                                                                        %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:103:50: note: expanded from macro 'LOGE'
#define LOGE(fmt, ...) LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__)
                             ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:90:37: note: expanded from macro 'LOGET'
                        __LINE__, ##__VA_ARGS__);                                                                      \
                                    ^~~~~~~~~~~
/home/wyu/github_projects/TNN/source/tnn/device/arm/acc/arm_pad_layer_acc.cc:48:81: warning: format specifies type 'unsigned long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE("Error: ArmPadLayerAcc layer acc does not support pas size %lu\n", pads.size());
                                                                        ~~~     ^~~~~~~~~~~
                                                                        %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:103:50: note: expanded from macro 'LOGE'
#define LOGE(fmt, ...) LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__)
                             ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:91:107: note: expanded from macro 'LOGET'
    fprintf(stderr, ("E/%s: %s [File %s][Line %d] " fmt), tag, __PRETTY_FUNCTION__, __FILE__, __LINE__, ##__VA_ARGS__)
                                                    ~~~                                                   ^~~~~~~~~~~
[  9%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_padv2_layer_acc.cc.o
/home/wyu/github_projects/TNN/source/tnn/device/arm/acc/arm_padv2_layer_acc.cc:36:90: warning: format specifies type 'unsigned long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE("Error: ArmPadV2LayerAcc layer acc does not support input dims size %lu\n", input_dims.size());
                                                                                 ~~~     ^~~~~~~~~~~~~~~~~
                                                                                 %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:103:50: note: expanded from macro 'LOGE'
#define LOGE(fmt, ...) LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__)
                             ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:90:37: note: expanded from macro 'LOGET'
                        __LINE__, ##__VA_ARGS__);                                                                      \
                                    ^~~~~~~~~~~
/home/wyu/github_projects/TNN/source/tnn/device/arm/acc/arm_padv2_layer_acc.cc:36:90: warning: format specifies type 'unsigned long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE("Error: ArmPadV2LayerAcc layer acc does not support input dims size %lu\n", input_dims.size());
                                                                                 ~~~     ^~~~~~~~~~~~~~~~~
                                                                                 %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:103:50: note: expanded from macro 'LOGE'
#define LOGE(fmt, ...) LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__)
                             ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:91:107: note: expanded from macro 'LOGET'
    fprintf(stderr, ("E/%s: %s [File %s][Line %d] " fmt), tag, __PRETTY_FUNCTION__, __FILE__, __LINE__, ##__VA_ARGS__)
                                                    ~~~                                                   ^~~~~~~~~~~
/home/wyu/github_projects/TNN/source/tnn/device/arm/acc/arm_padv2_layer_acc.cc:66:83: warning: format specifies type 'unsigned long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE("Error: ArmPadV2LayerAcc layer acc does not support pas size %lu\n", pads.size());
                                                                          ~~~     ^~~~~~~~~~~
                                                                          %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:103:50: note: expanded from macro 'LOGE'
#define LOGE(fmt, ...) LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__)
                             ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:90:37: note: expanded from macro 'LOGET'
                        __LINE__, ##__VA_ARGS__);                                                                      \
                                    ^~~~~~~~~~~
/home/wyu/github_projects/TNN/source/tnn/device/arm/acc/arm_padv2_layer_acc.cc:66:83: warning: format specifies type 'unsigned long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE("Error: ArmPadV2LayerAcc layer acc does not support pas size %lu\n", pads.size());
                                                                          ~~~     ^~~~~~~~~~~
                                                                          %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:103:50: note: expanded from macro 'LOGE'
#define LOGE(fmt, ...) LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__)
                             ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:91:107: note: expanded from macro 'LOGET'
    fprintf(stderr, ("E/%s: %s [File %s][Line %d] " fmt), tag, __PRETTY_FUNCTION__, __FILE__, __LINE__, ##__VA_ARGS__)
                                                    ~~~                                                   ^~~~~~~~~~~
[ 10%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_concat_layer_acc.cc.o
[ 11%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_permute_layer_acc.cc.o
4 warnings generated.
[ 11%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_pixel_shuffle_layer_acc.cc.o
4 warnings generated.
[ 11%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_pool_layer_acc.cc.o
[ 11%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_const_layer_acc.cc.o
[ 11%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_pow_layer_acc.cc.o
[ 11%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_prelu_layer_acc.cc.o
[ 11%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_priorbox_layer_acc.cc.o
[ 11%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_constantofshape_layer_acc.cc.o
[ 12%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reciprocal_layer_acc.cc.o
[ 12%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_l1_layer_acc.cc.o
[ 12%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_conv_1d_layer_acc.cc.o
[ 12%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_l2_layer_acc.cc.o
[ 12%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_layer_acc.cc.o
[ 12%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_log_sum_exp_layer_acc.cc.o
[ 12%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_conv_3d_layer_acc.cc.o
[ 12%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_log_sum_layer_acc.cc.o
[ 13%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_max_layer_acc.cc.o
[ 14%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_conv_layer_acc.cc.o
[ 14%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_mean_layer_acc.cc.o
[ 14%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_min_layer_acc.cc.o
[ 14%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_cos_layer_acc.cc.o
[ 14%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_prod_layer_acc.cc.o
[ 14%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_sum_layer_acc.cc.o
[ 15%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reduce_sum_square_layer_acc.cc.o
[ 15%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_deconv_layer_acc.cc.o
[ 15%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reformat_layer_acc.cc.o
[ 15%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_relu6_layer_acc.cc.o
[ 15%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_relu_layer_acc.cc.o
[ 15%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_detection_output_layer_acc.cc.o
[ 15%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reorg_layer_acc.cc.o
[ 15%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_reshape_layer_acc.cc.o
[ 15%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_detection_post_process_layer_acc.cc.o
[ 16%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_scale_layer_acc.cc.o
[ 16%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_selu_layer_acc.cc.o
[ 16%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_shuffle_layer_acc.cc.o
[ 16%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_div_layer_acc.cc.o
[ 16%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_sigmoid_layer_acc.cc.o
[ 16%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_sign_layer_acc.cc.o
[ 16%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_signed_mul_layer_acc.cc.o
[ 17%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_einsum_layer_acc.cc.o
[ 18%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_softmax_layer_acc.cc.o
[ 18%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_softplus_layer_acc.cc.o
[ 18%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_splitv_layer_acc.cc.o
[ 18%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_elu_layer_acc.cc.o
[ 18%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_sqrt_layer_acc.cc.o
[ 18%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_squeeze_layer_acc.cc.o
[ 18%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_equal_layer_acc.cc.o
[ 19%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_stride_slice_layer_acc.cc.o
[ 19%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_sub_layer_acc.cc.o
[ 19%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_tile_layer_acc.cc.o
[ 19%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_erf_layer_acc.cc.o
[ 19%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_trig_layer_acc.cc.o
[ 19%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_unary_layer_acc.cc.o
[ 19%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_exp_layer_acc.cc.o
[ 19%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_unsqueeze_layer_acc.cc.o
[ 20%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/arm_upsample_layer_acc.cc.o
[ 20%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/binary_function.cc.o
[ 20%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_expand_layer_acc.cc.o
[ 20%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/compute.cc.o
[ 20%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/compute_int8.cc.o
[ 20%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/gemm_function.cc.o
[ 21%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_flatten_layer_acc.cc.o
[ 21%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/winograd_function.cc.o
[ 22%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_int8_layer_1x1.cc.o
[ 22%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_int8_layer_common.cc.o
[ 22%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_int8_layer_depthwise.cc.o
[ 22%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_floor_layer_acc.cc.o
[ 22%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_layer_1x1.cc.o
[ 22%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_layer_3x3.cc.o
[ 23%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_layer_acc.cc.o
[ 23%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_gather_layer_acc.cc.o
[ 23%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_layer_acc_factory.cc.o
[ 23%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_gathernd_layer_acc.cc.o
[ 23%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_layer_c3.cc.o
[ 23%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_layer_common.cc.o
[ 23%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_layer_depthwise.cc.o
[ 23%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_gelu_layer_acc.cc.o
[ 23%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_layer_depthwise_s1.cc.o
[ 24%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/convolution/arm_conv_layer_group.cc.o
[ 25%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_gridsample_layer_acc.cc.o
[ 25%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/deconvolution/arm_deconv_layer_acc.cc.o
[ 25%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/deconvolution/arm_deconv_layer_common.cc.o
[ 25%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/deconvolution/arm_deconv_layer_depthwise.cc.o
[ 25%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_group_norm_layer_acc.cc.o
[ 25%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/deconvolution/arm_deconv_layer_stride.cc.o
[ 25%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/arm_blob_converter.cc.o
[ 26%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/arm_context.cc.o
[ 26%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_hard_sigmoid_layer_acc.cc.o
[ 26%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/arm_device.cc.o
[ 26%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/arm_mat_converter.cc.o
[ 26%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_hard_swish_layer_acc.cc.o
[ 26%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/arm_mat_util.cc.o
[ 26%] Building CXX object source/tnn/device/arm/CMakeFiles/TNNArm.dir/arm_util.cc.o
[ 26%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/CONV_BFP16_O4.S.o
[ 27%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/CONV_BFP16_SLIDEW_C3.S.o
[ 27%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/CONV_DW_3X3_BFP16_SLIDEW.S.o
[ 27%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/CONV_DW_3X3_FLOAT_SLIDEW.S.o
[ 27%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/CONV_DW_3X3_INT8_SLIDEW.S.o
[ 27%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/CONV_DW_5X5_BFP16_SLIDEW.S.o
[ 28%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/CONV_DW_5X5_FLOAT_SLIDEW.S.o
[ 28%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/CONV_FLOAT_O4.S.o
[ 28%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/CONV_FLOAT_SLIDEW_C3.S.o
[ 28%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/DECONV_FLOAT_O4.S.o
[ 28%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/GEMM_BFP16_N4.S.o
[ 28%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/GEMM_FLOAT_N4.S.o
[ 29%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/GEMM_INT8_4X4.S.o
[ 29%] Building ASM object source/tnn/device/arm/CMakeFiles/TNNArm.dir/acc/compute/arm32/GEMM_INT8_4X8.S.o
[ 29%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_hdrguide_layer_acc.cc.o
[ 29%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_inner_product_layer_acc.cc.o
[ 30%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_instance_norm_layer_acc.cc.o
[ 30%] Built target TNNArm
[ 30%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_inverse_layer_acc.cc.o
[ 30%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_layer_acc.cc.o
[ 30%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_layer_norm_layer_acc.cc.o
[ 30%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_log_layer_acc.cc.o
[ 30%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_log_sigmoid_layer_acc.cc.o
[ 31%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_lrn_layer_acc.cc.o
[ 31%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_lstm_layer_acc.cc.o
[ 31%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_mat_mul_layer_acc.cc.o
[ 31%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_max_layer_acc.cc.o
[ 31%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_min_layer_acc.cc.o
[ 31%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_mul_layer_acc.cc.o
[ 32%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_neg_layer_acc.cc.o
[ 32%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_nonzero_layer_acc.cc.o
[ 32%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_normalize_layer_acc.cc.o
[ 32%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_onehot_layer_acc.cc.o
[ 32%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_pad_layer_acc.cc.o
[ 33%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_padv2_layer_acc.cc.o
[ 33%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_permute_layer_acc.cc.o
[ 33%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_pixel_shuffle_layer_acc.cc.o
[ 33%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_pool_3d_layer_acc.cc.o
[ 33%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_pool_layer_acc.cc.o
[ 33%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_pow_layer_acc.cc.o
[ 34%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_prelu_layer_acc.cc.o
[ 34%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_prior_box_layer_acc.cc.o
[ 34%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_range_layer_acc.cc.o
[ 34%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reciprocal_layer_acc.cc.o
[ 34%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_l1_layer_acc.cc.o
[ 34%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_l2_layer_acc.cc.o
[ 35%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_layer_acc.cc.o
[ 35%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_log_sum_exp_layer_acc.cc.o
[ 35%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_log_sum_layer_acc.cc.o
[ 35%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_max_layer_acc.cc.o
[ 35%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_mean_layer_acc.cc.o
[ 36%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_min_layer_acc.cc.o
[ 36%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_prod_layer_acc.cc.o
[ 36%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_sum_layer_acc.cc.o
[ 36%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reduce_sum_square_layer_acc.cc.o
[ 36%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reformat_layer_acc.cc.o
[ 36%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_relu6_layer_acc.cc.o
[ 37%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_relu_layer_acc.cc.o
[ 37%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reorg_layer_acc.cc.o
[ 37%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_reshape_layer_acc.cc.o
[ 37%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_roialign_layer_acc.cc.o
[ 37%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_rsqrt_layer_acc.cc.o
[ 37%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_scale_layer_acc.cc.o
[ 38%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_scatter_nd_layer_acc.cc.o
[ 38%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_selu_layer_acc.cc.o
[ 38%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_shape_layer_acc.cc.o
[ 38%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_shuffle_layer_acc.cc.o
[ 38%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_sigmoid_layer_acc.cc.o
[ 39%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_sign_layer_acc.cc.o
[ 39%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_signed_mul_layer_acc.cc.o
[ 39%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_sin_layer_acc.cc.o
[ 39%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_size_layer_acc.cc.o
[ 39%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_softmax_layer_acc.cc.o
[ 39%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_softplus_layer_acc.cc.o
[ 40%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_splitv_layer_acc.cc.o
[ 40%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_sqrt_layer_acc.cc.o
[ 40%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_squared_difference_layer_acc.cc.o
[ 40%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_squeeze_layer_acc.cc.o
[ 40%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_stride_slice_layer_acc.cc.o
[ 40%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_stride_slice_v2_layer_acc.cc.o
[ 41%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_sub_layer_acc.cc.o
[ 41%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_tan_layer_acc.cc.o
[ 41%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_tanh_layer_acc.cc.o
[ 41%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_tile_layer_acc.cc.o
[ 41%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_topk_layer_acc.cc.o
[ 42%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_unary_layer_acc.cc.o
[ 42%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_unsqueeze_layer_acc.cc.o
[ 42%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_upsample_layer_acc.cc.o
[ 42%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/acc/cpu_where_layer_acc.cc.o
[ 42%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/cpu_blob_converter.cc.o
[ 42%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/cpu_context.cc.o
[ 43%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/cpu_device.cc.o
[ 43%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/cpu_mat_converter.cc.o
[ 43%] Building CXX object source/tnn/device/cpu/CMakeFiles/TNNCpu.dir/cpu_mat_util.cc.o
[ 43%] Built target TNNCpu
Scanning dependencies of target TNN
[ 43%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/abstract_device.cc.o
[ 43%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/abstract_layer_acc.cc.o
[ 43%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/abstract_network.cc.o
[ 43%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/blob.cc.o
[ 43%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/blob_impl.cc.o
[ 44%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/blob_int8.cc.o
[ 44%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/blob_manager.cc.o
[ 44%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/const_folder.cc.o
[ 44%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/context.cc.o
[ 44%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/default_network.cc.o
[ 44%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/instance.cc.o
[ 45%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/layer_type.cc.o
[ 45%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/mat.cc.o
[ 45%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/profile.cc.o
[ 45%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/status.cc.o
[ 45%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/tnn.cc.o
[ 45%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/tnn_impl.cc.o
[ 46%] Building CXX object CMakeFiles/TNN.dir/source/tnn/core/tnn_impl_default.cc.o
[ 46%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/abs_layer.cc.o
[ 46%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/acos_layer.cc.o
[ 46%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/add_layer.cc.o
[ 46%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/arg_max_or_min_layer.cc.o
[ 47%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/asin_layer.cc.o
[ 47%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/atan_layer.cc.o
[ 47%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/base_layer.cc.o
[ 47%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/batch_norm_layer.cc.o
[ 47%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/bias_add_layer.cc.o
[ 47%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/bitshift_layer.cc.o
[ 48%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/cast_layer.cc.o
[ 48%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/cbam_fused_pooling_layer.cc.o
[ 48%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/cbam_fused_reduce_layer.cc.o
[ 48%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/ceil_layer.cc.o
[ 48%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/clip_layer.cc.o
[ 48%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/concat_layer.cc.o
[ 49%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/constantofshape_layer.cc.o
[ 49%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/conv1d_layer.cc.o
[ 49%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/conv3d_layer.cc.o
[ 49%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/conv_layer.cc.o
[ 49%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/cos_layer.cc.o
[ 50%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/deconv_layer.cc.o
[ 50%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/detection_output_layer.cc.o
[ 50%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/detection_post_process_layer.cc.o
[ 50%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/div_layer.cc.o
[ 50%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/einsum_layer.cc.o
[ 50%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/elementwise_layer.cc.o
[ 51%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/elu_layer.cc.o
[ 51%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/equal_layer.cc.o
[ 51%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/erf_layer.cc.o
[ 51%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/exp_layer.cc.o
[ 51%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/expand_layer.cc.o
[ 51%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/flatten_layer.cc.o
[ 52%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/floor_layer.cc.o
[ 52%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/gather_layer.cc.o
[ 52%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/gathernd_layer.cc.o
[ 52%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/gelu_layer.cc.o
[ 52%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/gridsample_layer.cc.o
[ 53%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/group_norm_layer.cc.o
[ 53%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/hard_sigmoid_layer.cc.o
[ 53%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/hard_swish_layer.cc.o
[ 53%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/hdrguide_layer.cc.o
[ 53%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/histogram_layer.cc.o
[ 53%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/inner_product_layer.cc.o
[ 54%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/instance_norm_layer.cc.o
[ 54%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/inverse_layer.cc.o
[ 54%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/layer_norm_layer.cc.o
[ 54%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/log_layer.cc.o
[ 54%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/log_sigmoid_layer.cc.o
[ 54%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/lrn_layer.cc.o
[ 55%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/lstm_layer.cc.o
[ 55%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/mat_mul_layer.cc.o
[ 55%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/max_layer.cc.o
[ 55%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/min_layer.cc.o
[ 55%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/mul_layer.cc.o
[ 56%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/multidir_broadcast_layer.cc.o
[ 56%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/neg_layer.cc.o
[ 56%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/nonzero_layer.cc.o
[ 56%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/normalize_layer.cc.o
[ 56%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/onehot_layer.cc.o
[ 56%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/pad_layer.cc.o
[ 57%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/padv2_layer.cc.o
[ 57%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/permute_layer.cc.o
[ 57%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/pixel_shuffle_layer.cc.o
[ 57%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/pooling_3d_layer.cc.o
[ 57%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/pooling_layer.cc.o
[ 57%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/pow_layer.cc.o
[ 58%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/prelu_layer.cc.o
[ 58%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/prior_box_layer.cc.o
[ 58%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/range_layer.cc.o
[ 58%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reciprocal_layer.cc.o
[ 58%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_l1_layer.cc.o
[ 58%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_l2_layer.cc.o
[ 59%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_layer.cc.o
[ 59%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_log_sum_exp_layer.cc.o
[ 59%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_log_sum_layer.cc.o
[ 59%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_max_layer.cc.o
[ 59%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_mean_layer.cc.o
[ 60%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_min_layer.cc.o
[ 60%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_prod_layer.cc.o
[ 60%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_sum_layer.cc.o
[ 60%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reduce_sum_square_layer.cc.o
[ 60%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reformat_layer.cc.o
[ 60%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/relu6_layer.cc.o
[ 61%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/relu_layer.cc.o
[ 61%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reorg_layer.cc.o
[ 61%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/reshape_layer.cc.o
[ 61%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/roi_pooling_layer.cc.o
[ 61%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/roialign_layer.cc.o
[ 61%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/rsqrt_layer.cc.o
[ 62%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/scale_layer.cc.o
[ 62%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/scatter_nd_layer.cc.o
[ 62%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/selu_layer.cc.o
[ 62%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/shape_layer.cc.o
[ 62%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/shuffle_layer.cc.o
[ 63%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/sigmoid_layer.cc.o
[ 63%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/sign_layer.cc.o
[ 63%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/signed_mul_layer.cc.o
[ 63%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/sin_layer.cc.o
[ 63%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/size_layer.cc.o
[ 63%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/softmax_layer.cc.o
[ 64%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/softplus_layer.cc.o
[ 64%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/softsign_layer.cc.o
[ 64%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/split_layer.cc.o
[ 64%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/splitv_layer.cc.o
[ 64%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/sqrt_layer.cc.o
[ 64%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/squared_difference_layer.cc.o
[ 65%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/squeeze_layer.cc.o
[ 65%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/stride_slice_layer.cc.o
/home/wyu/github_projects/TNN/source/tnn/layer/stride_slice_layer.cc:44:97: warning: format specifies type 'long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE_IF(!ignore_error, "StrideSliceLayer param got wrong size: input dims size: %ld\n", input_dims.size());
                                                                                        ~~~     ^~~~~~~~~~~~~~~~~
                                                                                        %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:104:70: note: expanded from macro 'LOGE_IF'
#define LOGE_IF(cond, fmt, ...) if(cond) { LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__); }
                                                 ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:90:37: note: expanded from macro 'LOGET'
                        __LINE__, ##__VA_ARGS__);                                                                      \
                                    ^~~~~~~~~~~
/home/wyu/github_projects/TNN/source/tnn/layer/stride_slice_layer.cc:44:97: warning: format specifies type 'long' but the argument has type
      'std::__ndk1::vector<int, std::__ndk1::allocator<int> >::size_type' (aka 'unsigned int') [-Wformat]
        LOGE_IF(!ignore_error, "StrideSliceLayer param got wrong size: input dims size: %ld\n", input_dims.size());
                                                                                        ~~~     ^~~~~~~~~~~~~~~~~
                                                                                        %u
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:104:70: note: expanded from macro 'LOGE_IF'
#define LOGE_IF(cond, fmt, ...) if(cond) { LOGET(fmt, DEFAULT_TAG, ##__VA_ARGS__); }
                                                 ~~~                 ^~~~~~~~~~~
/home/wyu/github_projects/TNN/include/tnn/core/macro.h:91:107: note: expanded from macro 'LOGET'
    fprintf(stderr, ("E/%s: %s [File %s][Line %d] " fmt), tag, __PRETTY_FUNCTION__, __FILE__, __LINE__, ##__VA_ARGS__)
                                                    ~~~                                                   ^~~~~~~~~~~
[ 65%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/stride_slice_v2_layer.cc.o
[ 65%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/sub_layer.cc.o
[ 65%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/tan_layer.cc.o
2 warnings generated.
[ 66%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/tanh_layer.cc.o
[ 66%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/tile_layer.cc.o
[ 66%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/topk_layer.cc.o
[ 66%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/unsqueeze_layer.cc.o
[ 66%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/upsample_layer.cc.o
[ 66%] Building CXX object CMakeFiles/TNN.dir/source/tnn/layer/where_layer.cc.o
[ 67%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/bbox_util.cc.o
[ 67%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/bfp16_utils.cc.o
[ 67%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/blob_converter_default.cc.o
[ 67%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/blob_converter_internal.cc.o
[ 67%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/blob_dump_utils.cc.o
[ 67%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/blob_memory_size_utils.cc.o
[ 68%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/blob_transfer_utils.cc.o
[ 68%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/cpu_info.cc.o
[ 68%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/cpu_utils.cc.o
[ 68%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/data_flag_utils.cc.o
[ 68%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/data_format_converter.cc.o
[ 69%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/data_type_utils.cc.o
[ 69%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/detection_post_process_utils.cc.o
[ 69%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/dims_function_utils.cc.o
[ 69%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/dims_offset_utils.cc.o
[ 69%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/dims_vector_utils.cc.o
[ 69%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/half_utils.cc.o
[ 70%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/mat_converter_acc.cc.o
[ 70%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/mat_converter_utils.cc.o
[ 70%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/mat_utils.cc.o
[ 70%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/md5.cc.o
[ 70%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/naive_compute.cc.o
[ 70%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/npu_common_utils.cc.o
/home/wyu/github_projects/TNN/source/tnn/utils/md5.cc:63:11: warning: '&' within '|' [-Wbitwise-op-parentheses]
  return x&y | ~x&z;
         ~^~ ~
/home/wyu/github_projects/TNN/source/tnn/utils/md5.cc:63:11: note: place parentheses around the '&' expression to silence this warning
  return x&y | ~x&z;
          ^
         (  )
/home/wyu/github_projects/TNN/source/tnn/utils/md5.cc:63:18: warning: '&' within '|' [-Wbitwise-op-parentheses]
  return x&y | ~x&z;
             ~ ~~^~
/home/wyu/github_projects/TNN/source/tnn/utils/md5.cc:63:18: note: place parentheses around the '&' expression to silence this warning
  return x&y | ~x&z;
                 ^
               (   )
/home/wyu/github_projects/TNN/source/tnn/utils/md5.cc:67:11: warning: '&' within '|' [-Wbitwise-op-parentheses]
  return x&z | y&~z;
         ~^~ ~
/home/wyu/github_projects/TNN/source/tnn/utils/md5.cc:67:11: note: place parentheses around the '&' expression to silence this warning
  return x&z | y&~z;
          ^
         (  )
/home/wyu/github_projects/TNN/source/tnn/utils/md5.cc:67:17: warning: '&' within '|' [-Wbitwise-op-parentheses]
  return x&z | y&~z;
             ~ ~^~~
/home/wyu/github_projects/TNN/source/tnn/utils/md5.cc:67:17: note: place parentheses around the '&' expression to silence this warning
  return x&z | y&~z;
                ^
               (   )
[ 71%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/pad_utils.cc.o
4 warnings generated.
[ 71%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/pribox_generator_utils.cc.o
[ 71%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/random_data_utils.cc.o
[ 71%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/split_utils.cc.o
[ 71%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/string_format.cc.o
[ 71%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/string_utils.cc.o
[ 72%] Building CXX object CMakeFiles/TNN.dir/source/tnn/utils/winograd_generator.cc.o
[ 72%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/abstract_model_interpreter.cc.o
[ 72%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/default_model_interpreter.cc.o
[ 72%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/default_model_packer.cc.o
[ 72%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/layer_resource_generator.cc.o
[ 73%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/batch_norm_layer_interpreter.cc.o
[ 73%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/binary_op_interpreter.cc.o
[ 73%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/clip_layer_interpreter.cc.o
[ 73%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/concat_layer_interpreter.cc.o
[ 73%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/conv_layer_interpreter.cc.o
[ 73%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/crop_layer_interpreter.cc.o
[ 74%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/deconv_layer_interpreter.cc.o
[ 74%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/default_layer_interpreter.cc.o
[ 74%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/detection_output_layer_interpreter.cc.o
[ 74%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/eltwise_layer_interpreter.cc.o
[ 74%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/elu_layer_interpreter.cc.o
[ 74%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/hard_sigmoid_layer_interpreter.cc.o
[ 75%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/hard_swish_layer_interpreter.cc.o
[ 75%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/inner_product_layer_interpreter.cc.o
[ 75%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/instance_norm_layer_interpreter.cc.o
[ 75%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/interp_layer_interpreter.cc.o
[ 75%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/lrn_layer_interpreter.cc.o
[ 76%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/memory_data_layer_interpreter.cc.o
[ 76%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/normalize_layer_interpreter.cc.o
[ 76%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/pad_layer_interpreter.cc.o
[ 76%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/permute_layer_interpreter.cc.o
[ 76%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/pooling_layer_interpreter.cc.o
[ 76%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/prelu_layer_interpreter.cc.o
[ 77%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/prior_box_layer_interpreter.cc.o
[ 77%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/reduce_op_layer_interpreter.cc.o
[ 77%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/relu_layer_interpreter.cc.o
[ 77%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/reorg_layer_interpreter.cc.o
[ 77%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/reshape_layer_interpreter.cc.o
[ 77%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/roi_pooling_layer_interpreter.cc.o
[ 78%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/scale_layer_interpreter.cc.o
[ 78%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/selu_layer_interpreter.cc.o
[ 78%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/shuffle_channel_layer_interpreter.cc.o
[ 78%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/slice_layer_interpreter.cc.o
[ 78%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/softmax_layer_interpreter.cc.o
[ 79%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/layer_interpreter/unary_op_layer_interpreter.cc.o
[ 79%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/ncnn_layer_type.cc.o
[ 79%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/ncnn_model_interpreter.cc.o
[ 79%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/ncnn_param_utils.cc.o
[ 79%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/optimizer/expand_slice_optimizer.cc.o
[ 79%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/optimizer/memory_data_optimizer.cc.o
[ 80%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/ncnn/optimizer/ncnn_optimizer_manager.cc.o
[ 80%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/net_resource.cc.o
[ 80%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/net_structure.cc.o
[ 80%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/raw_buffer.cc.o
[ 80%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/add_layer_interpreter.cc.o
[ 80%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/arg_max_or_min_layer_interpreter.cc.o
[ 81%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/batch_norm_layer_interpreter.cc.o
[ 81%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/bias_add_layer_interpreter.cc.o
[ 81%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/bitshift_layer_interpreter.cc.o
[ 81%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/blob_scale_layer_interpreter.cc.o
[ 81%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/cast_layer_interpreter.cc.o
[ 82%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/clip_layer_interpreter.cc.o
[ 82%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/concat_layer_interpreter.cc.o
[ 82%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/const_layer_interpreter.cc.o
[ 82%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/constantofshape_layer_interpreter.cc.o
[ 82%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/conv_1d_layer_interpreter.cc.o
[ 82%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/conv_3d_layer_interpreter.cc.o
[ 83%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/conv_layer_interpreter.cc.o
[ 83%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/detection_output_interpreter.cc.o
[ 83%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/detection_post_process_layer_interpreter.cc.o
[ 83%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/div_layer_interpreter.cc.o
[ 83%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/einsum_layer_interpreter.cc.o
[ 83%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/elu_layer_interpreter.cc.o
[ 84%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/expand_layer_interpreter.cc.o
[ 84%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/flatten_layer_interpreter.cc.o
[ 84%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/gather_layer_interpreter.cc.o
[ 84%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/gathernd_layer_interpreter.cc.o
[ 84%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/gridsample_layer_interpreter.cc.o
[ 85%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/group_norm_layer_interpreter.cc.o
[ 85%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/hard_sigmoid_layer_interpreter.cc.o
[ 85%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/hard_swish_layer_interpreter.cc.o
[ 85%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/hdrguide_layer_interpreter.cc.o
[ 85%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/histogram_layer_interpreter.cc.o
[ 85%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/inner_product_layer_interpreter.cc.o
[ 86%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/instance_norm_layer_interpreter.cc.o
[ 86%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/layer_norm_layer_interpreter.cc.o
[ 86%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/lrn_layer_interpreter.cc.o
[ 86%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/lstm_layer_interpreter.cc.o
[ 86%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/mat_mul_layer_interpreter.cc.o
[ 86%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/max_layer_interpreter.cc.o
[ 87%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/min_layer_interpreter.cc.o
[ 87%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/mul_layer_interpreter.cc.o
[ 87%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/normalize_layer_interpreter.cc.o
[ 87%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/onehot_layer_interpreter.cc.o
[ 87%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/pad_layer_interpreter.cc.o
[ 87%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/padv2_layer_interpreter.cc.o
[ 88%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/permute_layer_interpreter.cc.o
[ 88%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/pixel_shuffle_layer_interpreter.cc.o
[ 88%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/pooling_3d_layer_interpreter.cc.o
[ 88%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/pooling_layer_interpreter.cc.o
[ 88%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/pow_layer_interpreter.cc.o
[ 89%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/prelu_layer_interpreter.cc.o
[ 89%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/prior_box_layer_interpreter.cc.o
[ 89%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/range_layer_interpreter.cc.o
[ 89%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/reduce_op_interpreter.cc.o
[ 89%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/reformat_layer_interpreter.cc.o
[ 89%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/reorg_layer_interpreter.cc.o
[ 90%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/reshape_layer_interpreter.cc.o
[ 90%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/roi_pooling_layer_interpreter.cc.o
[ 90%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/roialign_layer_interpreter.cc.o
[ 90%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/scale_layer_interpreter.cc.o
[ 90%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/scatter_nd_layer_interpreter.cc.o
[ 90%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/selu_layer_interpreter.cc.o
[ 91%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/shape_layer_interpreter.cc.o
[ 91%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/shuffle_layer_interpreter.cc.o
[ 91%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/signed_mul_layer_interpreter.cc.o
[ 91%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/size_layer_interpreter.cc.o
[ 91%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/softmax_layer_interpreter.cc.o
[ 92%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/splitv_layer_interpreter.cc.o
[ 92%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/squared_difference_layer_interpreter.cc.o
[ 92%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/squeeze_layer_interpreter.cc.o
[ 92%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/stride_slice_layer_interpreter.cc.o
[ 92%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/stride_slice_v2_layer_interpreter.cc.o
[ 92%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/sub_layer_interpreter.cc.o
[ 93%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/tile_layer_interpreter.cc.o
[ 93%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/topk_layer_interpreter.cc.o
[ 93%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/unary_op_layer_interpreter.cc.o
[ 93%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/unsqueeze_layer_interpreter.cc.o
[ 93%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/layer_interpreter/upsample_layer_interpreter.cc.o
[ 93%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/model_interpreter.cc.o
[ 94%] Building CXX object CMakeFiles/TNN.dir/source/tnn/interpreter/tnn/model_packer.cc.o
[ 94%] Building CXX object CMakeFiles/TNN.dir/source/tnn/optimizer/net_optimizer_cbam_fused_pooling.cc.o
[ 94%] Building CXX object CMakeFiles/TNN.dir/source/tnn/optimizer/net_optimizer_cbam_fused_reduce.cc.o
[ 94%] Building CXX object CMakeFiles/TNN.dir/source/tnn/optimizer/net_optimizer_fuse_conv_add.cc.o
[ 94%] Building CXX object CMakeFiles/TNN.dir/source/tnn/optimizer/net_optimizer_fuse_conv_post.cc.o
[ 95%] Building CXX object CMakeFiles/TNN.dir/source/tnn/optimizer/net_optimizer_insert_fp16_reformat.cc.o
[ 95%] Building CXX object CMakeFiles/TNN.dir/source/tnn/optimizer/net_optimizer_insert_int8_reformat.cc.o
[ 95%] Building CXX object CMakeFiles/TNN.dir/source/tnn/optimizer/net_optimizer_insert_layout_reformat.cc.o
[ 95%] Building CXX object CMakeFiles/TNN.dir/source/tnn/optimizer/net_optimizer_manager.cc.o
[ 95%] Building CXX object CMakeFiles/TNN.dir/source/tnn/optimizer/net_optimizer_remove_layers.cc.o
[ 95%] Building CXX object CMakeFiles/TNN.dir/source/tnn/extern_wrapper/base_layer_builder.cc.o
[ 96%] Building CXX object CMakeFiles/TNN.dir/source/tnn/extern_wrapper/foreign_blob.cc.o
[ 96%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/blob_1d_memory.cc.o
[ 96%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/blob_1d_memory_pool.cc.o
[ 96%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/blob_2d_memory.cc.o
[ 96%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/blob_2d_memory_pool.cc.o
[ 96%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/blob_memory.cc.o
[ 97%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/blob_memory_pool.cc.o
[ 97%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/blob_memory_pool_factory.cc.o
[ 97%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/blob_memory_size_info.cc.o
[ 97%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/memory_mode_state.cc.o
[ 97%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/memory_mode_state_factory.cc.o
[ 98%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/memory_seperate_assign_strategy.cc.o
[ 98%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/memory_unify_assign_strategy.cc.o
[ 98%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/others_memory_mode_state.cc.o
[ 98%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/share_one_thread_memory_mode_state.cc.o
[ 98%] Building CXX object CMakeFiles/TNN.dir/source/tnn/memory_manager/shared_memory_manager.cc.o
[ 98%] Linking CXX shared library libTNN.so
[ 98%] Built target TNN
Scanning dependencies of target TNNBenchmarkTest
Scanning dependencies of target TNNTest
[ 98%] Building CXX object test/CMakeFiles/TNNBenchmarkTest.dir/flags.cc.o
[ 98%] Building CXX object test/CMakeFiles/TNNTest.dir/test.cc.o
[ 98%] Building CXX object test/CMakeFiles/TNNTest.dir/flags.cc.o
[ 98%] Building CXX object test/CMakeFiles/TNNBenchmarkTest.dir/test.cc.o
[ 98%] Building CXX object test/CMakeFiles/TNNTest.dir/test_utils.cc.o
[ 98%] Building CXX object test/CMakeFiles/TNNBenchmarkTest.dir/test_utils.cc.o
[ 99%] Building CXX object test/CMakeFiles/TNNTest.dir/timer.cc.o
[ 99%] Building CXX object test/CMakeFiles/TNNBenchmarkTest.dir/timer.cc.o
[100%] Linking CXX shared library libTNNBenchmarkTest.so
[100%] Linking CXX executable TNNTest
[100%] Built target TNNBenchmarkTest
[100%] Built target TNNTest

  **5. 详细描述bug 情况 (Describe the bug)**
跑benchmark脚本未输出任何性能统计结果信息

  **6. 运行日志(runtime log)**
./libTNN.so: 1 file pushed. 4.6 MB/s (2595476 bytes in 0.533s)
./test/libTNNBenchmarkTest.so: 1 file pushed. 4.6 MB/s (153312 bytes in 0.032s)
test/TNNTest: 1 file pushed. 1.7 MB/s (120668 bytes in 0.066s)
/home/wyu/github_projects/TNN/benchmark/benchmark_android/../benchmark-model/: 1 file pushed. 2.5 MB/s (15435 bytes in 0.006s)
WARNING: linker: ./TNNTest: unused DT entry: type 0x6ffffffe arg 0x3d68
WARNING: linker: ./TNNTest: unused DT entry: type 0x6fffffff arg 0x3
WARNING: linker: libTNN.so: unused DT entry: type 0x6ffffffe arg 0x38d08
WARNING: linker: libTNN.so: unused DT entry: type 0x6fffffff arg 0x3
E/tnn: virtual tnn::Status tnn::BinaryLayerResourceGenerator::GenLayerResource(tnn::LayerParam *, tnn::LayerResource **, std::vector<Blob *> &) [File /home/wyu/github_projects/TNN/source/tnn/interpreter/layer_resource_generator.cc][Line 332] [WARNNING] can't infer resource shape from binary param in benchmark mode, random generator may not be exactly same with the real resource!
E/tnn: virtual tnn::Status tnn::BinaryLayerResourceGenerator::GenLayerResource(tnn::LayerParam *, tnn::LayerResource **, std::vector<Blob *> &) [File /home/wyu/github_projects/TNN/source/tnn/interpreter/layer_resource_generator.cc][Line 332] [WARNNING] can't infer resource shape from binary param in benchmark mode, random generator may not be exactly same with the real resource!
Segmentation fault
[model_for_benchmark.zip](https://github.com/Tencent/TNN/files/6763433/model_for_benchmark.zip)

脚本在运行推理时出现明显停顿,但在最后未输出任何性能统计结果信息,请问是什么原因,麻烦帮忙分析一下,该如何解决?模型详见附件文件
Wanger-SJTU commented 3 years ago

同样的问题,没有输出

quinnrong94 commented 3 years ago

@bestpower hotfix_issue_1109分支修复了附件中的模型运行失败的问题,请切换至该分支测试。

@Wanger-SJTU hotfix_issue_1109增加了android命令行log输出

bestpower commented 3 years ago

@bestpower hotfix_issue_1109分支修复了附件中的模型运行失败的问题,请切换至该分支测试。

我这边重新切了分支编译测试,之前的问题模型可以输出测试结果了,但我把之前能跑通的模型也同时做了测试,发现每个模型的平均耗时都比我之前测试的多了1/3左右, 测试参数配置和测试设备环境都和原来的一样,不知道是什么原因。

quinnrong94 commented 3 years ago

@bestpower 修复的问题只针对softmax层axis参数为负数的情况,对其他层不会有影响。如果测试发现有稳定的性能差异,麻烦提供对应的tnn版本号,编译选项,运行环境以及模型,以便我们复现。

bestpower commented 3 years ago

@bestpower 修复的问题只针对softmax层axis参数为负数的情况,对其他层不会有影响。如果测试发现有稳定的性能差异,麻烦提供对应的tnn版本号,编译选项,运行环境以及模型,以便我们复现。

我这边一直没有复现出来性能差异问题,原来的环境找不回来了,先暂时不管了,不过我这边用你说的这个分支上编译出来的库和转换的模型放到安卓端应用里推理得不到正确结果,我这个模型是做人脸检测的,节点输出的Dim都对,但是generate后没有任何人脸信息的输出,应该是模型转换还是有问题。

bestpower commented 3 years ago

@bestpower 修复的问题只针对softmax层axis参数为负数的情况,对其他层不会有影响。如果测试发现有稳定的性能差异,麻烦提供对应的tnn版本号,编译选项,运行环境以及模型,以便我们复现。

我这边一直没有复现出来性能差异问题,原来的环境找不回来了,先暂时不管了,不过我这边用你说的这个分支上编译出来的库和转换的模型放到安卓端应用里推理得不到正确结果,我这个模型是做人脸检测的,节点输出的Dim都对,但是generate后没有任何人脸信息的输出,应该是模型转换还是有问题。

补充:经验证原始onnx模型没有问题,同样的原始onnx模型,在通过mnn框架的转换与部署可以得到正确的结果,而在tnn上就不行,而generate代码用的是同一套。

quinnrong94 commented 3 years ago

@bestpower 转模型或者模型对齐问题,麻烦新开一个issue详细说明,我们会继续跟进。