nihui / ncnn-small-board

ncnn benchmark on various single board computers
158 stars 7 forks source link

Add orangepi5 benchmark #8

Closed triple-Mu closed 1 year ago

triple-Mu commented 1 year ago

Here is log:

(rknn) orangepi@orangepi5:~/Build/ncnn/build$ uname -a
Linux orangepi5 5.10.110-rockchip-rk3588 #1.1.4 SMP Wed Mar 8 14:50:47 CST 2023 aarch64 aarch64 aarch64 GNU/Linux
(rknn) orangepi@orangepi5:~/Build/ncnn/build$ lscpu
Architecture:                    aarch64
CPU op-mode(s):                  32-bit, 64-bit
Byte Order:                      Little Endian
CPU(s):                          8
On-line CPU(s) list:             0-7
Thread(s) per core:              1
Core(s) per socket:              2
Socket(s):                       3
Vendor ID:                       ARM
Model:                           0
Model name:                      Cortex-A55
Stepping:                        r2p0
CPU max MHz:                     2400.0000
CPU min MHz:                     408.0000
BogoMIPS:                        48.00
L1d cache:                       256 KiB
L1i cache:                       256 KiB
L2 cache:                        1 MiB
L3 cache:                        3 MiB
Vulnerability Itlb multihit:     Not affected
Vulnerability L1tf:              Not affected
Vulnerability Mds:               Not affected
Vulnerability Meltdown:          Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:        Mitigation; __user pointer sanitization
Vulnerability Spectre v2:        Vulnerable: Unprivileged eBPF enabled
Vulnerability Srbds:             Not affected
Vulnerability Tsx async abort:   Not affected
Flags:                           fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm lrcpc dcpop asimddp
(rknn) orangepi@orangepi5:~/Build/ncnn/build$ git log -n 1 master
commit 91090d793b80d4bd8453641607acfa984a9be383 (HEAD -> master, origin/master, origin/HEAD)
Author: nihui <nihuini@tencent.com>
Date:   Thu Jul 6 18:55:23 2023 +0800

    pnnx fix build, prepend batch for broadcast reshape (#4841)

    * fix build, prepend batch for broadcast reshape

    * sanitize filename

    * do not fuse to eltwise if broadcast

(rknn) orangepi@orangepi5:~/Build/ncnn/benchmark$ ../build/benchmark/benchncnn 10 4 2 -1 0
loop_count = 10
num_threads = 4
powersave = 2
gpu_device = -1
cooling_down = 0
          squeezenet  min =    3.76  max =    3.90  avg =    3.83
     squeezenet_int8  min =    4.56  max =    4.66  avg =    4.62
           mobilenet  min =    5.72  max =    5.79  avg =    5.75
      mobilenet_int8  min =    4.77  max =    4.89  avg =    4.82
        mobilenet_v2  min =    4.87  max =    4.98  avg =    4.91
        mobilenet_v3  min =    4.39  max =    4.43  avg =    4.41
          shufflenet  min =    3.55  max =    3.60  avg =    3.57
       shufflenet_v2  min =    2.89  max =    2.95  avg =    2.93
             mnasnet  min =    4.41  max =    4.53  avg =    4.47
     proxylessnasnet  min =    5.20  max =    5.27  avg =    5.23
     efficientnet_b0  min =    8.06  max =    8.15  avg =    8.11
   efficientnetv2_b0  min =   11.88  max =   11.96  avg =   11.92
        regnety_400m  min =    8.13  max =    8.22  avg =    8.17
           blazeface  min =    1.39  max =    1.46  avg =    1.43
           googlenet  min =   16.44  max =   16.53  avg =   16.48
      googlenet_int8  min =   16.61  max =   16.70  avg =   16.65
            resnet18  min =   10.48  max =   10.56  avg =   10.52
       resnet18_int8  min =   16.94  max =   17.01  avg =   16.98
             alexnet  min =   13.95  max =   14.04  avg =   13.98
               vgg16  min =   65.99  max =   66.17  avg =   66.08
          vgg16_int8  min =  134.59  max =  135.56  avg =  135.09
            resnet50  min =   28.46  max =   28.80  avg =   28.53
       resnet50_int8  min =   34.68  max =   34.86  avg =   34.79
      squeezenet_ssd  min =   14.86  max =   15.25  avg =   14.97
 squeezenet_ssd_int8  min =   18.99  max =   19.17  avg =   19.10
       mobilenet_ssd  min =   13.94  max =   14.14  avg =   14.03
  mobilenet_ssd_int8  min =   11.48  max =   11.62  avg =   11.53
      mobilenet_yolo  min =   32.92  max =   33.22  avg =   33.10
  mobilenetv2_yolov3  min =   19.88  max =   21.47  avg =   20.60
         yolov4-tiny  min =   25.67  max =   29.82  avg =   27.56
           nanodet_m  min =    7.15  max =    7.23  avg =    7.19
    yolo-fastest-1.1  min =    3.97  max =    4.02  avg =    3.99
      yolo-fastestv2  min =    3.55  max =    3.61  avg =    3.57
  vision_transformer  min =  433.35  max =  437.71  avg =  435.12
          FastestDet  min =    3.35  max =    3.40  avg =    3.37

Here is picture(From http://www.orangepi.cn/html/hardWare/computerAndMicrocontrollers/details/Orange-Pi-5.html): pi-5-banner-img

triple-Mu commented 1 year ago

How about this picture(From https://cdn.cnx-software.com/wp-content/uploads/2022/11/Orange-Pi-5.jpg?lossy=0&strip=none&ssl=1) Orange-Pi-5

nihui commented 1 year ago

Thanks for your contribution !