search

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
2.97k stars 171 forks source link

initial middleware manager #1437

Closed horheynm closed 9 months ago

horheynm commented 9 months ago

initial middleware manager implementation

Each middleware should inherit Middlware, and should define __name__, start_event and end_event