search

withcatai / catai

Run AI ✨ assistant locally! with simple API for Node.js 🚀
https://withcatai.github.io/catai/
MIT License
456 stars 30 forks source link

GPT4All-13B requires basic auth #20

Closed mledwards closed 1 year ago

mledwards commented 1 year ago

The fetch URL for GPT4All-13B (and a few others) requires a basic auth, so isn't downloadable from the models menu: https://huggingface.co/Pi3141/alpaca-GPT4All-13BB-ggml/resolve/main/ggml-model-q4_0.bi

Also, is the end meant to be .bin like the others?

ido-pluto commented 1 year ago

Update CatAI and try again. there was a problem with the installation

mledwards commented 1 year ago

That's downloading now, thanks! I'm struggling a bit with getting it working, I commented in another thread with a screenshot and you said you were fixing something. Happy to close this one, as it's only related to the downloading.

ido-pluto commented 1 year ago

I tested the model on my machine. If it does not work please share a screenshot and I will try to help you :)

mledwards commented 1 year ago

Oh, that's all working today! It's slooow on my machine, but we'll be provisioning a server to test it properly. Thanks again man!