gpt4all missing on docker image?

khoj-ai / khoj

Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our cloud instance. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.

https://khoj.dev

GNU Affero General Public License v3.0

12.63k stars 640 forks source link

gpt4all missing on docker image? #582

Closed bonzofenix closed 8 months ago

bonzofenix commented 9 months ago

After running docker compose up it fails with the following error:

No module named 'gpt4all'

aswinmohanme commented 9 months ago

I have run into the same bug as well. Running on MacOS with the latest 1.1.0 release.

debanjum commented 9 months ago

@bonzofenix are you also on Mac M1+ or a Linux ARM64 machine?

Khoj Offline Chat on ARM64 via Docker is not currently supported because the gpt4all dependency doesn't have an ARM64 build. You'll need to setup Khoj on your machine locally by following these instructions.

Were you hoping to use Khoj with an offline chat model? If so, I'll see if khoj server can start even with gpt4all not installed. So at least search, online chat can work using docker on ARM64 machines
I'll update the docs to warn about this scenario being unsupported

aswinmohanme commented 9 months ago

@bonzofenix are you also on Mac M1+ or a Linux ARM64 machine?

Khoj Offline Chat on ARM64 via Docker is not currently supported because the gpt4all dependency doesn't have an ARM64 build. You'll need to setup Khoj on your machine locally by following these instructions.

Were you hoping to use Khoj with an offline chat model? If so, I'll see if khoj server can start even with gpt4all not installed. So at least search, online chat can work using docker on ARM64 machines

I'll update the docs to warn about this scenario being unsupported

Yes, I'm running an M1 Macbook Air. Sorry for not mentioning that in my previous comment.

debanjum commented 8 months ago

No issues, thanks for confirming that. The only way around that for now is to install khoj directly on your machine, rather than via docker as mentioned above.