search

Soulter / hugging-chat-api

HuggingChat Python API🤗
GNU Affero General Public License v3.0
859 stars 123 forks source link

Model Overload Error #219

Closed Himanshu-369 closed 3 months ago

Himanshu-369 commented 6 months ago

I was just using the lightest "Phi-3" model and suddenly it gave Model overload Error. Used another id Still the same

Traceback (most recent call last): File "/home/user/new/.venv/lib/python3.11/site-packages/hugchat/hugchat.py", line 738, in _stream_query hugchat.exceptions.ChatError: Failed to parse response: {"type":"status","status":"error","message":"Model is overloaded"}

From couple of days i was using this api it sometimes acts strange and like Today the "web_search " function is not working properly, i set it to True and it sometimes switches off while giving the responses.

Soulter commented 6 months ago

That's a huggingface side problem, because too many people using this model and the server cannot keep up. You can change other models and try again.

github-actions[bot] commented 4 months ago

This issue was marked as stale because of inactivity.

github-actions[bot] commented 3 months ago

This issue was closed because of inactivity.