benchmark结果

xiaomi mix2 snapdragon 835

# CPU 1,2,4线程性能
# mnasnet_1.0_224 armv8-cpu threads:1,2,4
min=102048 max=102730 avg=102384
min=293583 max=355475 avg=328560
min=164904 max=211662 avg=189418

# mobilenet_v1_1.0_224 armv8-cpu threads:1,2,4
min=154950 max=156463 avg=155844
min=397915 max=472597 avg=435525
min=197265 max=287929 avg=252718

# mobilenet_v1_1.0_224_quant armv8-cpu threads:1,2,4
min=65783 max=66270 avg=66037.9
min=38575 max=38884 avg=38764
min=23286 max=23863 avg=23594.1

# mobilenet_v2_1.0_224 armv8-cpu threads:1,2,4
min=102584 max=103298 avg=103018
min=246394 max=341243 avg=308457
min=160923 max=212959 avg=186528

# mobilenet_v2_1.0_224_quant armv8-cpu threads:1,2,4
min=55023 max=55343 avg=55191.7
min=33395 max=33988 avg=33674.5
min=21856 max=22272 avg=22097.8

# nasnet_mobile armv8-cpu threads:1,2,4
min=229487 max=235007 avg=232925
min=700011 max=771798 avg=727812
min=675640 max=806278 avg=732020

# squeezentv1.0 armv8-cpu threads:1,2,4
min=214243 max=218894 avg=216610
min=349433 max=456087 avg=398142
min=202149 max=215569 avg=211357

huawei mate10 Kirin970

# ARMv8-CPU 1,2,4线程性能
# mnasnet_1.0_224 armv8-cpu threads:1,2,4
min=108165 max=109337 avg=108787
min=148973 max=167006 avg=159535
min=222008 max=229384 avg=224901

# mobilenet_v1_1.0_224 armv8-cpu threads:1,2,4
min=163745 max=171952 avg=166583
min=367913 max=384085 avg=372927
min=255050 max=282610 avg=273626

# mobilenet_v1_1.0_224_quant armv8-cpu threads:1,2,4
min=66699 max=66838 avg=66767.6
min=37413 max=37601 avg=37511.5
min=22707 max=22815 avg=22744.8

# mobilenet_v2_1.0_224 armv8-cpu threads:1,2,4
min=113392 max=143769 avg=117875
min=155522 max=166782 avg=161599
min=234480 max=239018 avg=236194

# mobilenet_v2_1.0_224_quant armv8-cpu threads:1,2,4
min=133474 max=134269 avg=133690
min=32370 max=32493 avg=32432.2
min=20993 max=21131 avg=21044.7

# nasnet_mobile armv8-cpu threads:1,2,4
min=238340 max=241155 avg=239684
min=680721 max=708213 avg=694333
min=576914 max=597362 avg=589411

# squeezentv1.0 armv8-cpu threads:1,2,4
min=230071 max=243180 avg=234774
min=183201 max=188201 avg=185056
min=286525 max=313425 avg=302760

xiaomi mix2 835 armv7 v8 cpu gpu

```shell INFO] ====== run benchmark of arm64-v8a ====== echo '[INFO] ==== arm64-v8a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite resolved reporter Initialized session in 50.607ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=226390 curr=102250 min=102250 max=226390 avg=136408 std=52191 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=102599 curr=102720 min=102048 max=102730 avg=102384 std=240 Average inference timings in us: Warmup: 136408, Init: 50607, no stats: 102384 echo '[INFO] ==== arm64-v8a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite resolved reporter Initialized session in 7.859ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=302768 curr=285460 min=266473 max=302768 avg=284746 std=12839 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=318911 curr=354378 min=293583 max=355475 avg=328560 std=20217 Average inference timings in us: Warmup: 284746, Init: 7859, no stats: 328560 echo '[INFO] ==== arm64-v8a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite resolved reporter Initialized session in 9.199ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=259143 curr=193983 min=178122 max=259143 avg=203342 std=32740 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=164904 curr=211662 min=164904 max=211662 avg=189418 std=14747 Average inference timings in us: Warmup: 203342, Init: 9199, no stats: 189418 echo '[INFO] ==== arm64-v8a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite resolved reporter Initialized session in 34.918ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=284451 curr=156671 min=156581 max=284451 avg=189512 std=54833 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=156366 curr=156326 min=154950 max=156463 avg=155844 std=542 Average inference timings in us: Warmup: 189512, Init: 34918, no stats: 155844 echo '[INFO] ==== arm64-v8a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite resolved reporter Initialized session in 4.493ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=458978 curr=475568 min=406502 max=475568 avg=448473 std=25618 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=426298 curr=452380 min=397915 max=472597 avg=435525 std=22001 Average inference timings in us: Warmup: 448473, Init: 4493, no stats: 435525 echo '[INFO] ==== arm64-v8a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite resolved reporter Initialized session in 9.265ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=343039 curr=297560 min=191335 max=343039 avg=276362 std=55074 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=274741 curr=253415 min=197265 max=287929 avg=252718 std=27359 Average inference timings in us: Warmup: 276362, Init: 9265, no stats: 252718 echo '[INFO] ==== arm64-v8a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite resolved reporter Initialized session in 23.796ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=5 first=216019 curr=66055 min=66055 max=216019 avg=104248 std=57927 Running benchmark for at least 10 iterations and at least 1 seconds count=15 first=65871 curr=66004 min=65783 max=66270 avg=66037.9 std=147 Average inference timings in us: Warmup: 104248, Init: 23796, no stats: 66037.9 echo '[INFO] ==== arm64-v8a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite resolved reporter Initialized session in 9.171ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=12 first=65982 curr=38746 min=38574 max=65982 avg=41027.5 std=7524 Running benchmark for at least 10 iterations and at least 1 seconds count=25 first=38760 curr=38839 min=38575 max=38884 avg=38764 std=82 Average inference timings in us: Warmup: 41027.5, Init: 9171, no stats: 38764 echo '[INFO] ==== arm64-v8a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite resolved reporter Initialized session in 10.011ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=18 first=59853 curr=23747 min=23471 max=59853 avg=25737.8 std=8275 Running benchmark for at least 10 iterations and at least 1 seconds count=39 first=23323 curr=23710 min=23286 max=23863 avg=23594.1 std=132 Average inference timings in us: Warmup: 25737.8, Init: 10011, no stats: 23594.1 echo '[INFO] ==== arm64-v8a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite resolved reporter Initialized session in 59.242ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=207413 curr=102994 min=102994 max=207413 avg=129596 std=44933 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=103028 curr=102940 min=102584 max=103298 avg=103018 std=215 Average inference timings in us: Warmup: 129596, Init: 59242, no stats: 103018 echo '[INFO] ==== arm64-v8a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite resolved reporter Initialized session in 7.84ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=392866 curr=243991 min=243991 max=392866 avg=312144 std=53024 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=307120 curr=328690 min=246394 max=341243 avg=308457 std=30623 Average inference timings in us: Warmup: 312144, Init: 7840, no stats: 308457 echo '[INFO] ==== arm64-v8a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] napi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite resolved reporter Initialized session in 6.94ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=276901 curr=212491 min=156934 max=276901 avg=205436 std=45854 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=182254 curr=176275 min=160923 max=212959 avg=186528 std=16366 Average inference timings in us: Warmup: 205436, Init: 6940, no stats: 186528 echo '[INFO] ==== arm64-v8a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite resolved reporter Initialized session in 17.221ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=9 first=82839 curr=55210 min=55022 max=82839 avg=58788.6 std=8632 Running benchmark for at least 10 iterations and at least 1 seconds count=18 first=55321 curr=55122 min=55023 max=55343 avg=55191.7 std=91 Average inference timings in us: Warmup: 58788.6, Init: 17221, no stats: 55191.7 echo '[INFO] ==== arm64-v8a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite resolved reporter Initialized session in 6.665ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=13 first=60365 curr=33460 min=33460 max=60365 avg=35710.4 std=7118 Running benchmark for at least 10 iterations and at least 1 seconds count=28 first=33517 curr=33395 min=33395 max=33988 avg=33674.5 std=139 Average inference timings in us: Warmup: 35710.4, Init: 6665, no stats: 33674.5 echo '[INFO] ==== arm64-v8a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite resolved reporter Initialized session in 11.217ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=19 first=57186 curr=21969 min=21963 max=57186 avg=23945.9 std=7835 Running benchmark for at least 10 iterations and at least 1 seconds count=41 first=22151 curr=22134 min=21856 max=22272 avg=22097.8 std=100 Average inference timings in us: Warmup: 23945.9, Init: 11217, no stats: 22097.8 echo '[INFO] ==== arm64-v8a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite resolved reporter Initialized session in 68.206ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=349261 curr=231607 min=231607 max=349261 avg=262784 std=49950 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=233479 curr=234133 min=229487 max=235007 avg=232925 std=1458 Average inference timings in us: Warmup: 262784, Init: 68206, no stats: 232925 echo '[INFO] ==== arm64-v8a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite resolved reporter Initialized session in 15.279ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=756755 curr=756978 min=701942 max=756978 avg=730092 std=26792 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=710385 curr=731584 min=700011 max=771798 avg=727812 std=19786 Average inference timings in us: Warmup: 730092, Init: 15279, no stats: 727812 echo '[INFO] ==== arm64-v8a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite resolved reporter Initialized session in 17.007ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=810973 curr=655597 min=655597 max=810973 avg=719834 std=56963 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=727251 curr=806278 min=675640 max=806278 avg=732020 std=44956 Average inference timings in us: Warmup: 719834, Init: 17007, no stats: 732020 echo '[INFO] ==== arm64-v8a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/squeezenet.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/squeezenet.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/squeezenet.tflite resolved reporter Initialized session in 22.348ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=277480 curr=220221 min=215864 max=277480 avg=233154 std=25641 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=216876 curr=218367 min=214243 max=218894 avg=216610 std=1440 Average inference timings in us: Warmup: 233154, Init: 22348, no stats: 216610 echo '[INFO] ==== arm64-v8a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/squeezenet.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/squeezenet.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/squeezenet.tflite resolved reporter Initialized session in 4.285ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=364730 curr=386949 min=364730 max=386949 avg=378021 std=9322 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=401832 curr=405837 min=349433 max=456087 avg=398142 std=27571 Average inference timings in us: Warmup: 378021, Init: 4285, no stats: 398142 echo '[INFO] ==== arm64-v8a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/squeezenet.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/squeezenet.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/squeezenet.tflite resolved reporter Initialized session in 6.02ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=248849 curr=206377 min=206377 max=248849 avg=220020 std=17212 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=214964 curr=214823 min=202149 max=215569 avg=211357 std=4383 Average inference timings in us: Warmup: 220020, Init: 6020, no stats: 211357 [INFO] ====== run benchmark of armeabi-v7a ====== echo '[INFO] ==== armeabi-v7a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite resolved reporter Initialized session in 9.924ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=191323 curr=120479 min=119986 max=191323 avg=138026 std=30771 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=121057 curr=120548 min=120331 max=121057 avg=120746 std=247 Average inference timings in us: Warmup: 138026, Init: 9924, no stats: 120746 echo '[INFO] ==== armeabi-v7a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite resolved reporter Initialized session in 6.268ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=340049 curr=371568 min=293091 max=371568 avg=343920 std=31995 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=368970 curr=370619 min=310545 max=370619 avg=343271 std=24354 Average inference timings in us: Warmup: 343920, Init: 6268, no stats: 343271 echo '[INFO] ==== armeabi-v7a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mnasnet_1.0_224.tflite resolved reporter Initialized session in 7.287ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=265097 curr=203435 min=181622 max=265097 avg=215374 std=30701 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=220391 curr=214542 min=196111 max=220516 avg=209784 std=7776 Average inference timings in us: Warmup: 215374, Init: 7287, no stats: 209784 echo '[INFO] ==== armeabi-v7a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite resolved reporter Initialized session in 11.469ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=201676 curr=176602 min=176602 max=201676 avg=183160 std=10694 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=176966 curr=177265 min=176880 max=178438 avg=177328 std=468 Average inference timings in us: Warmup: 183160, Init: 11469, no stats: 177328 echo '[INFO] ==== armeabi-v7a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite resolved reporter Initialized session in 4.807ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=538258 curr=415045 min=415045 max=538258 avg=462530 std=48896 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=500310 curr=460838 min=401968 max=500310 avg=451187 std=29458 Average inference timings in us: Warmup: 462530, Init: 4807, no stats: 451187 echo '[INFO] ==== armeabi-v7a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224.tflite resolved reporter Initialized session in 8.144ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=389834 curr=220307 min=220307 max=389834 avg=286564 std=62795 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=282966 curr=195654 min=195654 max=333289 avg=280658 std=33277 Average inference timings in us: Warmup: 286564, Init: 8144, no stats: 280658 echo '[INFO] ==== armeabi-v7a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite resolved reporter Initialized session in 5.795ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=6 first=113928 curr=84091 min=84055 max=113928 avg=89123.3 std=11093 Running benchmark for at least 10 iterations and at least 1 seconds count=12 first=83988 curr=84181 min=83988 max=84321 avg=84151.5 std=107 Average inference timings in us: Warmup: 89123.3, Init: 5795, no stats: 84151.5 echo '[INFO] ==== armeabi-v7a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite resolved reporter Initialized session in 8.459ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=9 first=77613 curr=52632 min=52531 max=77613 avg=55453.8 std=7835 Running benchmark for at least 10 iterations and at least 1 seconds count=19 first=52584 curr=52610 min=52386 max=52819 avg=52580.7 std=138 Average inference timings in us: Warmup: 55453.8, Init: 8459, no stats: 52580.7 echo '[INFO] ==== armeabi-v7a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v1_1.0_224_quant.tflite resolved reporter Initialized session in 8.977ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=12 first=81351 curr=34808 min=34784 max=81351 avg=38812.1 std=12826 Running benchmark for at least 10 iterations and at least 1 seconds count=27 first=34763 curr=34942 min=34744 max=35030 avg=34913.7 std=96 Average inference timings in us: Warmup: 38812.1, Init: 8977, no stats: 34913.7 echo '[INFO] ==== armeabi-v7a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite resolved reporter Initialized session in 8.687ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=150519 curr=117640 min=117228 max=150519 avg=125728 std=14314 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=117573 curr=117773 min=116456 max=118067 avg=117425 std=527 Average inference timings in us: Warmup: 125728, Init: 8687, no stats: 117425 echo '[INFO] ==== armeabi-v7a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite resolved reporter Initialized session in 4.94ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=440363 curr=285067 min=285067 max=440363 avg=358324 std=55120 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=349954 curr=285334 min=265540 max=363736 avg=311646 std=29228 Average inference timings in us: Warmup: 358324, Init: 4940, no stats: 311646 echo '[INFO] ==== armeabi-v7a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224.tflite resolved reporter Initialized session in 10.41ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=274689 curr=205514 min=183801 max=274689 avg=213606 std=36133 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=277677 curr=207721 min=188944 max=277677 avg=221586 std=25314 Average inference timings in us: Warmup: 213606, Init: 10410, no stats: 221586 echo '[INFO] ==== armeabi-v7a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite resolved reporter Initialized session in 5.682ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=6 first=100965 curr=76683 min=76473 max=100965 avg=80687.8 std=9068 Running benchmark for at least 10 iterations and at least 1 seconds count=13 first=76417 curr=76608 min=76360 max=76698 avg=76533.7 std=101 Average inference timings in us: Warmup: 80687.8, Init: 5682, no stats: 76533.7 echo '[INFO] ==== armeabi-v7a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite resolved reporter Initialized session in 10.973ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=9 first=80976 curr=49726 min=49598 max=80976 avg=53175.1 std=9829 Running benchmark for at least 10 iterations and at least 1 seconds count=20 first=49610 curr=49732 min=49480 max=49781 avg=49659.9 std=70 Average inference timings in us: Warmup: 53175.1, Init: 10973, no stats: 49659.9 echo '[INFO] ==== armeabi-v7a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite] Input layers: [] [104/1323] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/mobilenet_v2_1.0_224_quant.tflite resolved reporter Initialized session in 8.909ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=13 first=72912 curr=35139 min=35050 max=72912 avg=38113.9 std=10045 Running benchmark for at least 10 iterations and at least 1 seconds count=27 first=35295 curr=35244 min=34926 max=35318 avg=35193.4 std=95 Average inference timings in us: Warmup: 38113.9, Init: 8909, no stats: 35193.4 echo '[INFO] ==== armeabi-v7a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite resolved reporter Initialized session in 13.945ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=332774 curr=274521 min=273020 max=332774 avg=288481 std=25578 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=274918 curr=274914 min=271550 max=274918 avg=273334 std=1202 Average inference timings in us: Warmup: 288481, Init: 13945, no stats: 273334 echo '[INFO] ==== armeabi-v7a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite resolved reporter Initialized session in 15.718ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=871838 curr=854981 min=808482 max=871838 avg=836176 std=27880 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=824665 curr=862820 min=707351 max=862820 avg=808022 std=45955 Average inference timings in us: Warmup: 836176, Init: 15718, no stats: 808022 echo '[INFO] ==== armeabi-v7a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/nasnet_mobile.tflite resolved reporter Initialized session in 15.585ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=857723 curr=774023 min=774023 max=857723 avg=816632 std=32162 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=933802 curr=800755 min=732696 max=933802 avg=832086 std=49531 Average inference timings in us: Warmup: 816632, Init: 15585, no stats: 832086 echo '[INFO] ==== armeabi-v7a USE_GPU:false-1 /data/local/tmp/tflite/tfmodel/squeezenet.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [1] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/squeezenet.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/squeezenet.tflite resolved reporter Initialized session in 8.635ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=261536 curr=247037 min=246826 max=261536 avg=250728 std=6245 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=245381 curr=244403 min=243895 max=250325 avg=246635 std=2089 Average inference timings in us: Warmup: 250728, Init: 8635, no stats: 246635 echo '[INFO] ==== armeabi-v7a USE_GPU:false-2 /data/local/tmp/tflite/tfmodel/squeezenet.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [2] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/squeezenet.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/squeezenet.tflite resolved reporter Initialized session in 9.309ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=469032 curr=430128 min=430128 max=469032 avg=449477 std=18390 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=407699 curr=435180 min=388080 max=453334 avg=429236 std=17684 Average inference timings in us: Warmup: 449477, Init: 9309, no stats: 429236 echo '[INFO] ==== armeabi-v7a USE_GPU:false-4 /data/local/tmp/tflite/tfmodel/squeezenet.tflite ====' STARTING! Min num runs: [10] Min runs duration (seconds): [1] Inter-run delay (seconds): [-1] Num threads: [4] Benchmark name: [] Output prefix: [] Min warmup runs: [4] Min warmup runs duration (seconds): [0.5] Graph: [/data/local/tmp/tflite/tfmodel/squeezenet.tflite] Input layers: [] Input shapes: [] Use nnapi : [0] nnapi error: unable to open library libneuralnetworks.so Loaded model /data/local/tmp/tflite/tfmodel/squeezenet.tflite resolved reporter Initialized session in 5.703ms Running benchmark for at least 4 iterations and at least 0.5 seconds count=4 first=284225 curr=242139 min=242139 max=284225 avg=255010 std=16993 Running benchmark for at least 10 iterations and at least 1 seconds count=10 first=243158 curr=238631 min=238631 max=252177 avg=246793 std=3821 Average inference timings in us: Warmup: 255010, Init: 5703, no stats: 246793 ```

yuenshome / yuenshome.github.io

tflite benchmark #77

基本概况

编译和benchmark

benchmark结果

xiaomi mix2 snapdragon 835

huawei mate10 Kirin970