xorbitsai / inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
https://inference.readthedocs.io
Apache License 2.0
5.4k stars 438 forks source link

Kolors在ui可视化界面处,无法使用本地模型进行运行处理 #2144

Closed 1148330040 closed 2 months ago

1148330040 commented 2 months ago

System Info / 系統信息

python3.10 Ubuntu pip install "xinference[all]"

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?

Version info / 版本信息

pip install "xinference[all]"

The command used to start Xinference / 用以启动 xinference 的命令

shell命令行启动 xinference-local --host 0.0.0.0 --port 9997

Reproduction / 复现过程

1:xinference-local --host 0.0.0.0 --port 9997启动 2:在ui界面选择使用 1724320968900

3:错误信息: 1724321003129

Expected behavior / 期待表现

可以使用本地模型进行运行部署

qinxuye commented 2 months ago

Kolors 没有上传 diffusers 格式的到 modelscope,目前只有 hf 上有:https://huggingface.co/Kwai-Kolors/Kolors-diffusers

可以让他们官方传一份到 ModelScope。

1148330040 commented 2 months ago

Kolors 没有上传 diffusers 格式的到 modelscope,目前只有 hf 上有:https://huggingface.co/Kwai-Kolors/Kolors-diffusers

可以让他们官方传一份到 ModelScope。

明白了,谢谢~

qinxuye commented 2 months ago

先 close。