search

replicate / cog-flux

Cog inference for flux models
https://replicate.com/black-forest-labs/flux-dev
Apache License 2.0
272 stars 28 forks source link

Torch compile #11

Closed daanelson closed 1 month ago

daanelson commented 1 month ago

Torch.compiles flux-dev, goes from 3 it/sec to 6 it/sec. Progress!