Open 0xNullLight opened 10 months ago
Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! :hugs:
If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively.
You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! :wave:
Welcome to the Jupyter community! :tada:
Hi @Hcrypt! Thanks so much for filing this issue. Do you see this with all models under Hugging Face Hub? I tried to use the same model, and while I didn't see the error you saw with the prompt hello
, I got a timeout:
[E 2024-01-11 17:04:42.622 AiExtension] Error raised by inference API: Model WizardLM/WizardCoder-Python-34B-V1.0 time out
[I 2024-01-11 17:04:42.628 ServerApp] Default chat handler resolved in 334501 ms.
Do you see the same error with other model providers?
Yea, I get the same error with all the models. How did set yours up to get it working? Just curious so I can follow through exactly what you went through just to double check what's happening here.
I typically build and run Jupyter AI from source, using the ./scripts/install.sh
script from my local jupyter-ai
repository. If you still see this bug with the newest published version of Jupyter AI (2.9.1), could you please try with the tip of the main
branch? Thanks!
Description
I'm trying to use a huggingface api with jupyter_ai
I keep getting this
I already retried re-installing jupyter_ai multiple times with
pip install jupyter-ai
I even tried..
pip3 install jupyter_ai --upgrade --force-reinstall
not sure why I keep getting that error..Reproduce
After installing jupyter-ai, I attempt to use the Jupyter AI Chat. Added
WizardLM/WizardCoder-Python-34B-V1.0
on Local model ID added my api on hugging face (write)Type in hello on the chat..
Expected behavior
I expected the chatbot to respond back to me. But it didn't. Instead on the terminal I used to open up jupyter-labs it says..
I went back to the browser, click entered and the IndexError mention above popped up
Context
Troubleshoot Output