flux-dev faster with tensorrt compared to without (bf16, windows)

comfyanonymous / ComfyUI_TensorRT

MIT License

513 stars 34 forks source link

Closed doctorpangloss closed 1 month ago

doctorpangloss commented 1 month ago

pytorch 2.4.1:

1.22s/it

tensorrt compiled:

1.06s/it

Ooops lol