search

filipstrand / mflux

A MLX port of FLUX based on the Huggingface Diffusers implementation.
656 stars 48 forks source link

Why GPU usage is low? #25

Closed smoothdvd closed 2 weeks ago

smoothdvd commented 2 weeks ago

python main.py --model dev --prompt "Luxury food photograph" --steps 25 --seed 2

Screenshot 2024-09-01 at 6 51 38 PM
filipstrand commented 2 weeks ago

Hi @smoothdvd , my guess is that you are memory limited.

Have you tried running the model in -q 8 or -q 4 mode? For example:

python main.py --model schnell --prompt "Luxury food photograph" --steps 2 --seed 2 -q 8
smoothdvd commented 2 weeks ago

@filipstrand You are right! Thank you for your help.