neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs

https://neuralmagic.com/deepsparse/

Other

2.94k stars 169 forks source link

Closed dsikka closed 4 months ago

dsikka commented 4 months ago

Summary

Update our docs to be reflective of some of the defaults which have been updated for text generation
Not a requirement for 1.7 but for completeness, should be up-to-date

New table: Screenshot 2024-02-13 at 4 00 49 PM