neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs

https://neuralmagic.com/deepsparse/

Other

2.94k stars 169 forks source link

Closed dsikka closed 5 months ago

dsikka commented 5 months ago

Summary

Add a quick helper function which supports non-kwarg for model_path when using the TextGeneration pathway
For this ticket: https://app.asana.com/0/1206109050183159/1206524727025314/f

The following now works:

from deepsparse import TextGeneration
model_path = "hf:mgoin/TinyStories-1M-ds"

pipe = TextGeneration(model_path)

This still works:


model_path  = TextGeneration(model_path=model_path)