search

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
2.97k stars 171 forks source link

Does he support stable diffusion or fooocus, or other image generation acceleration? #1339

Closed libai-lab closed 10 months ago

libai-lab commented 10 months ago

Does he support stable diffusion or fooocus, or other image generation acceleration?If so, how can I use it? Is there a tutorial?

jeanniefinks commented 10 months ago

Hi @libai-lab DeepSparse can technically run stable diffusion. However, optimization benefits and additional robust support for image generation models would be potentially on a longer-term roadmap and not in the near- or medium-term. We are focusing on a subset of LLMs and will have exciting news to share by the end of the year.

I will archive your message and note it for reference as we plan our future roadmaps. Thank you! Jeannie / Neural Magic