search

comfyanonymous / ComfyUI_TensorRT

MIT License
507 stars 34 forks source link

[Feature request] Support flux fp16 and fp8 #57

Open aikitoria opened 3 months ago

aikitoria commented 3 months ago

You know you want it 👀

tebjan commented 3 months ago

It looks like there are some issues with the torch.bfloat16 type as mentioned here: https://huggingface.co/black-forest-labs/FLUX.1-dev/discussions/24

Related: microsoft/onnxruntime#13001 microsoft/onnxscript#1462 microsoft/onnxscript#1492