search

nomic-ai / gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
https://nomic.ai/gpt4all
MIT License
70.37k stars 7.68k forks source link

Chat didn't start at all #903

Closed husseinmleng closed 1 year ago

husseinmleng commented 1 year ago

Issue you'd like to raise.

I'm using ubuntu 23.04 when I have installed the gpt4all and downloaded Mosaic MPT7B model the followwing error occures when trying to luanch the chat: [Warning] (Thu Jun 8 14:19:24 2023): Could not connect "org.freedesktop.IBus" to globalEngineChanged(QString) [Debug] (Thu Jun 8 14:19:24 2023): deserializing chats took: 0 ms mpt_model_load: loading model from '/home/huusein/.local/share/nomic.ai/GPT4All//ggml-mpt-7b-chat.bin' - please wait ... mpt_model_load: n_vocab = 50432 mpt_model_load: n_ctx = 2048 mpt_model_load: n_embd = 4096 mpt_model_load: n_head = 32 mpt_model_load: n_layer = 32 mpt_model_load: alibi_bias_max = 8.000000 mpt_model_load: clip_qkv = 0.000000 mpt_model_load: ftype = 2 Illegal instruction (core dumped)

Suggestion:

No response

cosmic-snow commented 1 year ago

What version of the chat application are you using?

Maybe this is another case of the 'AVX only' problem. What you could check is whether AVX2 is supported on your machine.

If you don't know how, there's for example the inxi tool from the package of the same name. Run inxi -Cx and check the "Flags" line: if it doesn't include avx2 then you're running into that bug.

For example, mine says (on a Linux Mint test VM): image

I do have avx2 there, though.

husseinmleng commented 1 year ago

What version of the chat application are you using?

Maybe this is another case of the 'AVX only' problem. What you could check is whether AVX2 is supported on your machine.

If you don't know how, there's for example the inxi tool from the package of the same name. Run inxi -Cx and check the "Flags" line: if it doesn't include avx2 then you're running into that bug.

For example, mine says (on a Linux Mint test VM): image

I do have avx2 there, though.

Screenshot_20230609_101326

I have checked but there is no avx2 I have 'avx' only does that means that I will not be able to use GPT4ALL on my laptop ?

niv280 commented 1 year ago

I have the same problem, I'm running ubuntu virtual machine on my laptop and I don't got avx2 instructions. There is any way to workaround that issue?

cosmic-snow commented 1 year ago

I have checked but there is no avx2 I have 'avx' only does that means that I will not be able to use GPT4ALL on my laptop ?

I have the same problem, I'm running ubuntu virtual machine on my laptop and I don't got avx2 instructions. There is any way to workaround that issue?

You will be able to, but there's a bug that needs to be fixed/released. Stay tuned.

The workaround currently is to build yourself with a working version, but for the chat application that's quite some work.

Related:

cebtenzzre commented 1 year ago

Duplicate of #865