nod-ai / SHARK-Studio

SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution
Apache License 2.0
1.42k stars 171 forks source link

pip install accelerate in .exe version #946

Open Marormur opened 1 year ago

Marormur commented 1 year ago

When I'm using the .exe (version 20230203.494) I'm getting this message:

Cannot initialize model with low cpu memory usage because `accelerate` was not found in the environment. Defaulting to `low_cpu_mem_usage=False`. It is strongly recommended to install `accelerate` for faster and less memory-intense model loading. You can do so with:

pip install accelerate

Is it possible you can include the installation of that in the .exe?

powderluv commented 1 year ago

It is about 3GB and we don't need it / use it. The exe would balloon up. It would be nice if HF didn't send such messages or there is a way to disable it.

cytoph commented 1 year ago

I installed it but still get the error, so what exactly do I have to do for this?