Closed ZoroarkGER closed 1 year ago
I think it's because of your choice of computer case and system fans 🙄
To be fair, op probably had that pre written.
Perhaps try another loader like GPTQ-for-llama. It loads with autogptq now.
To be fair, op probably had that pre written.
Perhaps try another loader like GPTQ-for-llama. It loads with autogptq now.
i tried all of the options, and i get the same thing over and over again, i've read that it may be a thing where it preloads the model into the system ram and then into the vram and that maybe my ram isnt enough but my ram maxes out at 10gb when loading any model and 7b models work as i already mentioned.
Make a bigger swap file and try to load that way.
Make a bigger swap file and try to load that way.
what's a swap file and how do i do that?
Edit: I knew what that was just under a different name
I think you are able to google what the swap file is for and how to set its size in Windows. In German it's called "Auslagerungsdatei".
I think you are able to google what the swap file is for and how to set its size in Windows. In German it's called "Auslagerungsdatei".
Yea, that's exactly the word I knew it under. Though I already made a pretty big swap file for playing games like 7 Days to Die as it needs a lot of RAM, but I'll see if an even bigger one will do. I just wonder why it needs so much RAM out of a sudden or if it is even a RAM issue as it never occurred before.
Thank you so much, I set a 32GB RAM swap file and it finally loaded, though with both my RAM and SSD maxed out at 100%.
Make a bigger swap file and try to load that way.
For anyone who has the same issue as me, try this ^^^^
Describe the bug
The web UI was working fine for me, I could load 7b and 13b models without problems. But all of that changed after updating to the latest version, in which I now get a "Done! Press any key to continue..." every time I try to load a model. I have no clue why that is and why it's doing that but I hope this problem will be solved The only model that I seem to be able to run at the moment is the Guanaco 7b model, while all the other 13b models I have just won't load anymore.
I also don't seem to be the first and only person to encounter this problem and I've spent my whole day trying fixes that worked for others, which turned out not to work for me though.
Yes, I also tried a complete reinstallation of the web UI.
Is there an existing issue for this?
Reproduction
Try to load a 13b model in the latest branch of the web UI on a machine with similar specs to mine.
Screenshot
No response
Logs
System Info