Open PotatoDestroyer opened 1 year ago
What kind of model were you trying to load? I guess 8 GB is not that much but should work fine with smaller modells like https://huggingface.co/TheBloke/wizardLM-7B-GGML although even the smalles modell need 6.3 Gb at least.
crashing after adding a lot of PDFs on low end PC