siliconflow / onediff

OneDiff: An out-of-the-box acceleration library for diffusion models.
https://github.com/siliconflow/onediff/wiki
Apache License 2.0
1.71k stars 105 forks source link

Can not accelerate Flux #1122

Open ngsitrong26 opened 1 month ago

ngsitrong26 commented 1 month ago

📚 The doc issue

Cache lookup: Key='f12c528d-c6e1-4c7c-b361-033cfb8417b6', Cached Model Type='<class 'NoneType'>' Warning: Model <class 'comfy.ldm.flux.model.Flux'> is not an FP16 model. Compilation will be skipped!

Does Onediff Flux only work with fp16

But Flux is loaded in type bf16, I have tried loading in fp16 but the result is all black image

Suggest a potential alternative/fix

No response