search

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
3.01k stars 176 forks source link

[TextGeneration][Bug] Fix timer #1294

Closed dsikka closed 1 year ago

dsikka commented 1 year ago

For this ticket: https://app.asana.com/0/1205229323407165/1205618233879512/f

Tested locally with gradio/non-gradio examples