Closed tianbinraindrop closed 10 months ago
Hi! Thanks for reporting this issue.
Listing running models hangs could happen when your model is still loading, which could take 3-5 minutes for baichuan. This is a known problem and will be fixed soon.
can't load any models include chatglm etc...
Closed by #546
Describe the bug
A clear and concise description of what the bug is. Although the model was able to load, it did not respond for a long time. I can't use "xinference list" to list any running model.
To Reproduce
To help us to reproduce this bug, please provide information below:
Expected behavior
A clear and concise description of what you expected to happen. I load baichuan-2 chat model to chat,but can't interface.
Additional context
Add any other context about the problem here. the debug log is below.
so i use webui to show running model is suspend,and use "xinference list" to list but get no response. My cpu is normal, My nvidia is 4090 ti is lightly load. what's wrong with xinference.