search

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
2.97k stars 171 forks source link

[V2 Pipeline] Middleware Timer #1454

Closed horheynm closed 8 months ago

horheynm commented 8 months ago

Blocked on https://github.com/neuralmagic/deepsparse/pull/1450

Add Timer to intercept each time Pipeline/Op callable is called Timer recordings capturing selected sections of code in pipeline or ops