search

xorbitsai / inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
https://inference.readthedocs.io
Apache License 2.0
4.99k stars 396 forks source link

BUG- xinference list cmdline run error #1383

Closed miracletiger closed 1 month ago

miracletiger commented 5 months ago

Describe the bug

xinference list Traceback (most recent call last): File "/data/anaconda3/envs/xinfer/bin/xinference", line 8, in sys.exit(cli()) ^^^^^ File "/data/personal/zonghu.wang/.local/lib/python3.11/site-packages/click/core.py", line 1157, in call return self.main(args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/data/personal/zonghu.wang/.local/lib/python3.11/site-packages/click/core.py", line 1078, in main rv = self.invoke(ctx) ^^^^^^^^^^^^^^^^ File "/data/personal/zonghu.wang/.local/lib/python3.11/site-packages/click/core.py", line 1688, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/data/personal/zonghu.wang/.local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke return ctx.invoke(self.callback, ctx.params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/data/personal/zonghu.wang/.local/lib/python3.11/site-packages/click/core.py", line 783, in invoke return __callback(args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/data/anaconda3/envs/xinfer/lib/python3.11/site-packages/xinference/deploy/cmdline.py", line 679, in model_list if model_spec["model_type"] == "LLM":


TypeError: string indices must be integers, not 'str'
### To Reproduce
python3.11 
xinference, version 0.9.1
ChengjieLi28 commented 5 months ago

@miracletiger Uprade xinference to v0.10.3, then try your command.

github-actions[bot] commented 1 month ago

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] commented 1 month ago

This issue was closed because it has been inactive for 5 days since being marked as stale.