V2 middleware timer - Githubissues

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs

https://neuralmagic.com/deepsparse/

Other

2.97k stars 171 forks source link

V2 middleware timer #1443

Closed horheynm closed 9 months ago

horheynm commented 9 months ago

Add timer into middleware

examples in tests

Blocked on https://github.com/neuralmagic/deepsparse/pull/1437