search

Atinoda / text-generation-webui-docker

Docker variants of oobabooga's text-generation-webui, including pre-built images.
GNU Affero General Public License v3.0
399 stars 78 forks source link

Support for arm CPUs? #53

Open RiskierSubset opened 4 months ago

RiskierSubset commented 4 months ago

Pretty much the title. Will greatly appreciate if it's possible to have this work on arm.

Atinoda commented 4 months ago

Hi @RiskierSubset, I don't think that the upstream project supports ARM. It might be possible but I don't know if any of the backends support hardware accelerators that are compatible with, or built-in to, ARM platforms.

Out of curiosity - what use case or system do you have in mind?