Stuck on loading model - Githubissues

ohmplatform / FreedomGPT

This codebase is for a React and Electron-based app that executes the FreedomGPT LLM locally (offline and private) on Mac and Windows using a chat-based interface

http://www.freedomgpt.com

GNU General Public License v3.0

2.58k stars 346 forks source link

Stuck on loading model #91

Open MrRorls12 opened 1 year ago

MrRorls12 commented 1 year ago

Size: 729.13 GB Available | RAM: 15.88 GB Available

RobbyFrank commented 1 year ago

I have the same issue as well on a Windows 10 PC.

Tried deleting and downloading again.
Tried running as administrator.
Tried moving the model to the desktop and loading from there.

Unfortunately, nothing worked so far...

This is the error I'm getting when running through Yarn:

ghost commented 1 year ago

That is because your CPU doesn't support AVX or Advanced Vector Extensions. And if your CPU don't support AVX, then no matter how you try, the app isn't going to run on your device.

Solofandek commented 1 year ago

Got the same problem, stuck on loading screen, I have 2 Xeon E5-2680 CPU's / 64RAM / GTX 980Ti This is from my CPU, it does support AVX but not AVX2 do you think it should work on my PC ? Check screenshot HWiNFO.

https://imgur.com/a/0152KK3

theoxandmoon commented 1 year ago

Also having the same problem. I was able to use FreedomGPT before, but now it won't go past the "Loading Model" screen.

Windows 11 CPU Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz 2.21 GHz 15.7GB RAM available

KrishnaKumarSoni commented 1 year ago

Same issue. Using MacBook Pro M1 (8 GB RAM)

victorvilella commented 1 year ago

Got the same problem, stuck on loading screen, I have 2 Xeon E5-2680 CPU's / 64RAM / GTX 980Ti This is from my CPU, it does support AVX but not AVX2 do you think it should work on my PC ? Check screenshot HWiNFO.

https://imgur.com/a/0152KK3

Same problem here. My processor supports AVX but doesn't support AVX2.

Crilum commented 1 year ago

I get the same problem, but my CPU supports AVX2.. Any ideas?

w-sky commented 1 year ago

Oh no, why doesn't it say on the main page if FreedomGPT will not run on all processors. Mine is Intel i5-9300H … which has SSE4.1, SSE4.2, AVX2. Exactly as above. Then it should work, I guess.

Does FreedomGPT also use the GPU if available?

jpmc commented 11 months ago

Same problem:

Windows 10
AMD CPU that supports AVX, AVX2, up to SSE4.2, etc
GTX 1070

Using the EXE installer version from the homepage, downloaded ALPACA model, and got stuck at Model Loading with zero indicators or anything for ages. Just the process hitting 4.5GB and sitting.