search

pythoninoffice / amd_webui

55 stars 10 forks source link

Cannot initialize model with low cpu memory usage #4

Open rexorp opened 1 year ago

rexorp commented 1 year ago

Cannot initialize model with low cpu memory usage because accelerate was not found in the environment. Defaulting to low_cpu_mem_usage=False. It is strongly recommended to install accelerate for faster and less memory-intense model loading. You can do so with:


pip install accelerate
NZedPred commented 1 year ago

As a quick fix, you can add an entry to the requirements.txt file. Just add a line with 'accelerate' (without the quotes) and it will install it the next time you run start.bat.