search

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
2.97k stars 171 forks source link

Non-invasive middleware implementation for Ops and Pipeline #1450

Closed horheynm closed 9 months ago

horheynm commented 9 months ago

Timer middleware stuff will be created in a separated PR

(.venv) george@quad-mle-1:~/deepsparse$ pytest '/home/george/deepsparse/tests/deepsparse/v2/middleware/test_middleware.py'
=========================== test session starts ===========================
platform linux -- Python 3.10.13, pytest-7.4.3, pluggy-1.3.0
rootdir: /home/george/deepsparse
configfile: pyproject.toml
plugins: flaky-3.7.0
collected 4 items                                                         

tests/deepsparse/v2/middleware/test_middleware.py ....              [100%]

============================ 4 passed in 0.86s ============================
(.venv) george@quad-mle-1:~/deepsparse$