Open sestren opened 1 month ago
@sestren cpu
images do not have a python environment to save on size. just use the latest
tag, or any other image that is not having the core
tag. See also docs here: https://localai.io/basics/container/#standard-container-images
I tried the latest tag. However this tag also incorporate the call to download gpt4, vision, etc models.
I used latest-cpu
instead of latest-aio-cpu
or latest
as per the documentation (i.e. One without the -core
flag) as I understood it world act as the latest-aio-cpu without the packaged models.
LocalAI version:
LocalAI v2.19.4 Docker Image ID: d99f62d40302 / TAG: latest-cpu
Environment, CPU architecture, OS, and Version:
uname -a: Linux XXX 6.8.0-39-generic #39~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Wed Jul 10 15:35:09 UTC 2 x86_64 x86_64 x86_64 GNU/Linux CPU: AMD Ryzen 9 5950X 16-Core Processor RAM: 32 GB
Describe the bug
Load by default stablediffusion instead diffusers not working
To Reproduce
Pull latest
latest-cpu
image and run it with the the environnement variableCOMPEL=0
I set up dreamshaper usinglocal-ai models install dreamshaper
, and change the "dreamshaper.yaml" in models folder with content:Then ran command as stated in docs:
Expected behavior
Unable to load the generation, always have this log
However, when following the same steps using the
localai/localai:v2.19.4-ffmpeg
docker image, it works.Logs