Any plans for controlnet + inpainting support?

aredden / flux-fp8-api

Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x faster on consumer devices.

Apache License 2.0

202 stars 21 forks source link

Any plans for controlnet + inpainting support? #15

Open 0xtempest opened 1 month ago

0xtempest commented 1 month ago

I can start with some PR's when I have some time as well if there are no plans for this

aredden commented 1 month ago

I did work on adding ip-adapter but found that ip-adapter wasn't very good so I didn't bother adding it. If controlnet is better then I could add that- or you could work on it if you wanted.

reesekneeland commented 2 weeks ago

@aredden I am interested in using the IP Adapter with your flux implementation. I understand it has its issues, but it would still be a useful tool for me if we could get it working. Do you have an estimate of how much work this would take? Do you have a partial implementation I could work from, or that you would be willing to finish integrating?