neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs

https://neuralmagic.com/deepsparse/

Other

2.97k stars 171 forks source link

[Feature Branch] The almighty V2 #1422

Closed dbogunowicz closed 9 months ago

dbogunowicz commented 9 months ago

Summary

Feature branch to merge v2 into main
All v2 and existing v1 transformer tests are passing