neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
2.98k stars 172 forks source link

[WiP] Working on few improvements for v2 LLM pipeline #1363

Closed dbogunowicz closed 10 months ago