search

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
2.94k stars 169 forks source link

[BugFix] Add analyze callable #1574

Closed rahul-tuli closed 5 months ago

rahul-tuli commented 5 months ago

Add missing analyze function and top level callable

from deepsparse import analyze

analysis = analyze("zoo:mobilenet_v1-1.0-imagenette-base")
analysis.summary().pretty_print()

Output:

$ python local/descriptions/analyze_bug.py                                                                   (add-analyze-callable|✚2…3⚑1)
2024-02-02 05:08:18 deepsparse.analyze INFO     Analysis complete, collating results...
DeepSparse, Copyright 2021-present / Neuralmagic, Inc. version: 1.7.0.20240104 COMMUNITY | (86c38139) (release) (optimized) (system=avx512, binary=avx512)
Node Timings for Benchmark # 1:
 NODE_NAME                      AVG_RUNTIME                    
 Conv_55                        0.02                           
 Conv_60                        0.04                           
 Conv_65                        0.01                           
 Conv_70                        0.08                           
 Conv_75                        0.01                           
 Conv_80                        0.08                           
 Conv_85                        0.01                           
 Conv_90                        0.08                           
 Conv_95                        0.01                           
 Conv_100                       0.08                           
 Conv_105                       0.01                           
 Conv_110                       0.08                           
 Conv_115                       0.01                           
 Conv_120                       0.05                           
 Conv_125                       0.01                           
 Conv_130                       0.10                           
 AveragePool_137                0.00                           
 Gemm_144                       0.01                           
 Softmax_145                    0.00                           

Params:
 MODEL                          SPARSITY                       QUANTIZED                      COUNT                          SIZE                           
 zoo:mobilenet_v1-1.0-          0.00                           0.00                           3195338                        102250816                      
 imagenette-base                                                                                                                                            

Ops:
 MODEL                          SPARSITY                       QUANTIZED                      COUNT                          SIZE                           
 zoo:mobilenet_v1-1.0-          0.00                           0.00                           3195402                        102252864                      
 imagenette-base                                                                                                                                            

Overall:
 MODEL                          LATENCY                        THROUGHPUT                     SUPPORTED_GRAPH                SPARSITY                       QUANTIZED                      
 zoo:mobilenet_v1-1.0-          1.28                           781.43                         1.00                           0.00                           0.00                           
 imagenette-base