invoke-ai / InvokeAI

InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multiple commercial products.
https://invoke-ai.github.io/InvokeAI/
Apache License 2.0
22.81k stars 2.36k forks source link

[enhancement]: Please support FLUX.1 #6712

Open DavidCWGA opened 1 month ago

DavidCWGA commented 1 month ago

Is there an existing issue for this?

Contact Details

david@gloveraoki.net

What should this feature add?

Please support the new open-weights models from Black Forest Labs, FLUX.1.

https://huggingface.co/black-forest-labs

Alternatives

No response

Additional Content

No response

AlgorithmicKing commented 1 month ago

yes please really really need it

rufeng0411 commented 1 month ago

Flux is super impressive, can't wait!

DualProphecy commented 1 month ago

🙏yes please

Chiaki commented 1 month ago

Can't wait to see fulx support in InvokeAi

rufeng0411 commented 1 month ago

please add flux,thanks alot

ChibiChiii commented 1 month ago

After extensively testing the versatility and accuracy of the Flux 1 model I can confidently say adding this model to Invoke AI would be a very large +. The quality of this model is like none other, creating accurate text at 98% times of the requests, having the prompt accuracy of Dall-E yet the versatality of Midjourney supporting Art-mediums from Watercolor painting to Anime/Manga Sketches. A rather impressive creation of Black Forrest indeed.

jvnte commented 1 month ago

Having that would be awesome!!!

sonny4723 commented 1 month ago

Can't wait!

jameswan commented 1 month ago

I already have Flux working in an InvokeAI workflow

ChibiChiii commented 1 month ago

I already have Flux working in an InvokeAI workflow

would you be able & willing to create instructions as to how you did this? I think it would be very useful for other users as well as Flux is a very high-end model but at the moment most people need to use ComfyUI to use it.

jameswan commented 1 month ago

I already have Flux working in an InvokeAI workflow

would you be able & willing to create instructions as to how you did this? I think it would be very useful for other users as well as Flux is a very high-end model but at the moment most people need to use ComfyUI to use it.

image
jvnte commented 1 month ago

New Diffusers release now supports FluxPipeline: https://github.com/huggingface/diffusers/releases/tag/v0.30.0

jameswan commented 1 month ago

If that didn't work for you, then this:

image
rufeng0411 commented 1 month ago

please support flux !

yescine commented 1 month ago

didn' t worked downloading form HF black-forest-labs/FLUX.1-schnell

MDsniper commented 1 month ago

I already have Flux working in an InvokeAI workflow

would you be able & willing to create instructions as to how you did this? I think it would be very useful for other users as well as Flux is a very high-end model but at the moment most people need to use ComfyUI to use it.

Screenshot 2024-08-09 at 5 32 21 PM
MDsniper commented 1 month ago

yeah Lies

sammcj commented 1 month ago

Howdy folks, I have no doubt that the Invoke team will be more than aware of Flux, what a leap forward it is and how the community is very keen to get it working with their favourite tool.

Although it's great to see the enthusiasm in the comments I would suggest showing your interest with an emoji reaction on the post, freeing up the comments for folks that have suggestions on how to help implement it.

This will help keep the signal to noise ratio high and although I'm not a maintainer - I could imagine I might find it a little stressful or feel like it's being demanded / expected (although I'm sure that's not the case).

Just my 2c and a ❤️ out to the maintainers of such a great open source tool.

MDsniper commented 1 month ago

Fair point

On Fri, Aug 9, 2024 at 17:41 Sam @.***> wrote:

Howdy folks, I have no doubt that the Invoke team will be more than aware of Flux, what a leap forward it is and how the community is very keen to get it working with their favourite tool.

Although it's great to see the enthusiasm in the comments I would suggest showing your interest with an emoji reaction on the post, freeing up the comments for folks that have suggestions on how to help implement it.

This will help keep the signal to noise ratio high and although I'm not a maintainer - I could imagine I might find it a little stressful or feel like it's being demanded / expected (although I'm sure that's not the case).

Just my 2c and a ❤️ out to the maintainers of such a great open source tool.

— Reply to this email directly, view it on GitHub https://github.com/invoke-ai/InvokeAI/issues/6712#issuecomment-2278790316, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJSLCLGZ2AZJZEU5E6YQZO3ZQUZRNAVCNFSM6AAAAABL5FTWSGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENZYG44TAMZRGY . You are receiving this because you commented.Message ID: @.***>

airtonix commented 1 month ago

I already have Flux working in an InvokeAI workflow

so was this a lie?

Yes because they didn't screenshot the import outcome like @MDsniper did. (╯°□°)╯︵ ┻━┻

airtonix commented 1 month ago

Error is

[2024-08-10 13:49:18,230]::[ModelInstallService]::ERROR --> Model install error: black-forest-labs/FLUX.1-dev

InvalidModelConfigException: Unable to determine model type for /mnt/Store/Applications/InvokeAi/models/tmpinstall_dd9x7x7x/FLUX.1-dev;

class FluxPipeline is not one of the supported classes [
  StableDiffusionPipeline,
  StableDiffusionInpaintPipeline,
  StableDiffusionXLPipeline,
  StableDiffusionXLImg2ImgPipeline,
  StableDiffusionXLInpaintPipeline,
  LatentConsistencyModelPipeline,
  AutoencoderKL,
  AutoencoderTiny,
  ControlNetModel,
  CLIPVisionModelWithProjection,
  T2IAdapter
]
brhndursun commented 1 month ago

bump!

rufeng0411 commented 1 month ago

UP!

kwal559 commented 1 month ago

This is why we use other interfaces The devs here dont care that you want it. Nor do they care about Playground 2.5, or Kolors, or Aura, Flux, SD 3, or presets for Pony, or for so much, so much, because you aren't a paying customer. Search all you like, there is no guide to install these major models. So, download pinokio and choose from several different UI's to use them.. Even if you have 4 gigs of vram.. Some people just care enough to get things to work (and in 1 click installs). pinokio.computer (web site/download the app) will only give you one problem.. harddrive space.

DavidCWGA commented 1 month ago

For what it's worth, I've been using "Draw Things" on my Mac, which already supports Flux. The UI is a little quirky, but it's a native app and runs very well. And it's free.

brhndursun commented 1 month ago

bump!

well, 4 thumbs down from devs I guess. Deleting invokeAI. I'll will try pinokio as @kwal559 mentioned

Thank you @sammcj

sammcj commented 1 month ago

Folks, come on it's ok to be excited and even a little impatient at times but there's no need to rip out open source maintainers that write software for you for free. They owe you nothing.

brhndursun commented 1 month ago

We're thinking in the simple way. If other apps can run flux with a little research and upgrades, why anybody in community not making a PR for flux?

sammcj commented 1 month ago

I'm fairly sure there are PRs underway to get Flux working, e.g. https://github.com/invoke-ai/InvokeAI/pull/6739 - it just seems they're not ready yet.

When you compare InvokeAI to some of the other tools out there that have implemented it - InvokeAI is more of a product, it's large and is generally held to high standards, this is quite different from something like Comfy which is esentially a lot of different peoples scripts and packages that can be glued together in various ways - people can make great things due to the flexibility but - it's also a lot harder and much less refined.

I'm sure that if it was as simple as simply supporting the model, invoke would already have flux, but while I have no insider knowledge I'm assuming it's probably included as part of a larger piece of work with the intent of a better integrated outcome. (I'm just guessing here).

brhndursun commented 1 month ago

You're right. I think I got a little too exited about flux. Also that pr was opened 2 days ago. I've subscribed now and will keep a close eye on it.

dbent commented 1 month ago

bump!

well, 4 thumbs down from devs I guess. Deleting invokeAI. I'll will try pinokio as @kwal559 mentioned

Thank you @sammcj

For the record, I am one of the people that downvoted you and I am neither a developer of nor contributor to Invoke. The reason being that when you're subscribed to an issue GitHub sends an email for each comment. Your comment of "bump!" is not constructive and amounts to nothing more than spam in however many people's inboxes who have subscribed. There isn't even anything to "bump" since this isn't a classic forum thread where visibility is affected by the most recent comment. It's also especially glaring in light of the extremely kind and patient comment from @sammcj earlier informing people that the proper way to express interest in an issue on GitHub is via reaction emojis.

Now, I have to apologize to everyone I have further spammed for simply making this comment, but I wished to clarify things in case passerbys were left with the wrong impression due to your misattributed slight.

hipsterusername commented 1 month ago

@sammcj - Thanks. :)

For all, please recognize that unlike many other UIs, we have a much wider maintenance and development mandate. I appreciate people voicing their interest in it.

We’re aware of Flux, and we’re actively looking at setting up the foundation to support it long term, but that is a rapidly changing landscape.

In addition to building this application, we’re actively spearheading work with the Open Model Initiative (joined the Linux Foundation this week), working to develop stronger IP protection for creators using these tools, and working on one of the biggest updates there has ever been to the canvas. We’re doing a lot for the ecosystem.

If you’re interested in seeing the process of adopting new features speed up, consider participating as a contributor. Else, I’d ask that you serve as an active cheerleader and vocal evangelist of our efforts as opposed to an entitled user of free and open source software.

Thanks to all who’ve been patient advocates - I hope you’ll be pleased with what we’ve got planned for you.

sonny4723 commented 1 month ago

@sammcj - Thanks. :)

For all, please recognize that unlike many other UIs, we have a much wider maintenance and development mandate. I appreciate people voicing their interest in it.

We’re aware of Flux, and we’re actively looking at setting up the foundation to support it long term, but that is a rapidly changing landscape.

In addition to building this application, we’re actively spearheading work with the Open Model Initiative (joined the Linux Foundation this week), working to develop stronger IP protection for creators using these tools, and working on one of the biggest updates there has ever been to the canvas. We’re doing a lot for the ecosystem.

If you’re interested in seeing the process of adopting new features speed up, consider participating as a contributor. Else, I’d ask that you serve as an active cheerleader and vocal evangelist of our efforts as opposed to an entitled user of free and open source software.

Thanks to all who’ve been patient advocates - I hope you’ll be pleased with what we’ve got planned for you.

Take your time. I love Invoke and I believe in you guys!

Trismegiste commented 4 weeks ago

We're thinking in the simple way. If other apps can run flux with a little research and upgrades, why anybody in community not making a PR for flux?

If it's so simple, what are you waiting for to contribute to this repo ? :roll_eyes:

rufeng0411 commented 4 weeks ago

we need flux,please

sonny4723 commented 3 weeks ago

We're thinking in the simple way. If other apps can run flux with a little research and upgrades, why anybody in community not making a PR for flux?

If it's so simple, what are you waiting for to contribute to this repo ? 🙄

Totally agree! Plz guys, just wait and keep calm. Invoke team is very responsible for the community and they always listen to the community feedback if it's possible. Even with SD1.5, Invoke is still damn good! Just wait!

brhndursun commented 3 weeks ago

@sammcj - Thanks. :)

For all, please recognize that unlike many other UIs, we have a much wider maintenance and development mandate. I appreciate people voicing their interest in it.

We’re aware of Flux, and we’re actively looking at setting up the foundation to support it long term, but that is a rapidly changing landscape.

In addition to building this application, we’re actively spearheading work with the Open Model Initiative (joined the Linux Foundation this week), working to develop stronger IP protection for creators using these tools, and working on one of the biggest updates there has ever been to the canvas. We’re doing a lot for the ecosystem.

If you’re interested in seeing the process of adopting new features speed up, consider participating as a contributor. Else, I’d ask that you serve as an active cheerleader and vocal evangelist of our efforts as opposed to an entitled user of free and open source software.

Thanks to all who’ve been patient advocates - I hope you’ll be pleased with what we’ve got planned for you.

So you mean flux is not your first priority. I dont think you guys care ppls thoughts on this platform. Even though you removed upgrade section cuz it is not working and we must download new installer. Dude just forget everything and make flux your first priority.

We're thinking in the simple way. If other apps can run flux with a little research and upgrades, why anybody in community not making a PR for flux?

If it's so simple, what are you waiting for to contribute to this repo ? 🙄

It is not about me. It is about even simple apps have managed to work with flux so why not invoke? Also it's been 2 weeks(18 days) since flux released. Enough said, up! bump! you guys have to make this one for your first priority.

Feel free to thumbsdown this comment. I'll thank you later

AlgorithmicKing commented 3 weeks ago

@sammcj - Thanks. :) For all, please recognize that unlike many other UIs, we have a much wider maintenance and development mandate. I appreciate people voicing their interest in it. We’re aware of Flux, and we’re actively looking at setting up the foundation to support it long term, but that is a rapidly changing landscape. In addition to building this application, we’re actively spearheading work with the Open Model Initiative (joined the Linux Foundation this week), working to develop stronger IP protection for creators using these tools, and working on one of the biggest updates there has ever been to the canvas. We’re doing a lot for the ecosystem. If you’re interested in seeing the process of adopting new features speed up, consider participating as a contributor. Else, I’d ask that you serve as an active cheerleader and vocal evangelist of our efforts as opposed to an entitled user of free and open source software. Thanks to all who’ve been patient advocates - I hope you’ll be pleased with what we’ve got planned for you.

So you mean flux is not your first priority. I dont think you guys care ppls thoughts on this platform. Even though you removed upgrade section cuz it is not working and we must download new installer. Dude just forget everything and make flux your first priority.

We're thinking in the simple way. If other apps can run flux with a little research and upgrades, why anybody in community not making a PR for flux?

If it's so simple, what are you waiting for to contribute to this repo ? 🙄

It is not about me. It is about even simple apps have managed to work with flux so why not invoke? Also it's been 2 weeks(18 days) since flux released. Enough said, up! bump! you guys have to make this one for your first priority.

Feel free to thumbsdown this comment. I'll thank you later

+1

rufeng0411 commented 3 weeks ago

@sammcj - Thanks. :) For all, please recognize that unlike many other UIs, we have a much wider maintenance and development mandate. I appreciate people voicing their interest in it. We’re aware of Flux, and we’re actively looking at setting up the foundation to support it long term, but that is a rapidly changing landscape. In addition to building this application, we’re actively spearheading work with the Open Model Initiative (joined the Linux Foundation this week), working to develop stronger IP protection for creators using these tools, and working on one of the biggest updates there has ever been to the canvas. We’re doing a lot for the ecosystem. If you’re interested in seeing the process of adopting new features speed up, consider participating as a contributor. Else, I’d ask that you serve as an active cheerleader and vocal evangelist of our efforts as opposed to an entitled user of free and open source software. Thanks to all who’ve been patient advocates - I hope you’ll be pleased with what we’ve got planned for you.

So you mean flux is not your first priority. I dont think you guys care ppls thoughts on this platform. Even though you removed upgrade section cuz it is not working and we must download new installer. Dude just forget everything and make flux your first priority.

We're thinking in the simple way. If other apps can run flux with a little research and upgrades, why anybody in community not making a PR for flux?

If it's so simple, what are you waiting for to contribute to this repo ? 🙄

It is not about me. It is about even simple apps have managed to work with flux so why not invoke? Also it's been 2 weeks(18 days) since flux released. Enough said, up! bump! you guys have to make this one for your first priority.

Feel free to thumbsdown this comment. I'll thank you later

+1

+1

Trismegiste commented 3 weeks ago

@brhndursun

Deleting invokeAI. I'll will try pinokio as @kwal559 mentioned

This is not an airport, no need to announce your departure

brhndursun commented 3 weeks ago

@brhndursun

Deleting invokeAI. I'll will try pinokio as @kwal559 mentioned

This is not an airport, no need to announce your departure

Thank you for your funny joke but I think I can tell anything except hurting your feelings. Did that hurt you?

Also I made my own way to use flux. I told you, it is not that hard. I guess invoke core system makes it harder to implement. I can use comfy too but I just want to use it in invoke that's all.

brhndursun commented 3 weeks ago

@brhndursun

Deleting invokeAI. I'll will try pinokio as @kwal559 mentioned

This is not an airport, no need to announce your departure

Thank you for your funny joke but I think I can tell anything except hurting your feelings. Did that hurt you? Also I made my own way to use flux. I told you, it is not that hard. I guess invoke core system makes it harder to implement. I can use comfy too but I just want to use it in invoke that's all.

So if you found your own way, you could of found a way to implement it into invokes codebase and shared it.

The only reason I'm not attempting it is because I don't have the time, but you had enough time to make your own implementation of it....

So why not just fork and push and share it with us?

It is working on pure python without front end or invoke. I don't have time to work with invoke system. You can use ComfyUI or huggingface spaces too.

deepblue96 commented 3 weeks ago

As much as I love comfyUI I would also like to be able to use invoke with Flux, so please add support.

mirek190 commented 3 weeks ago

I am also waiting for it!

brandonrising commented 2 weeks ago

An initial experimental implementation of Flux is now available on v4.2.9rc1! We will be working on extending it to support different formats of the base model as well as loras/img2img/etc over the next week or two. Please refer to the release notes to see how flux is installed and used in its current form within Invoke if you choose to install this release candidate. Thank you everyone for your patience!

sammcj commented 2 weeks ago

Love your work! ❤️

Thank you everyone for your patience

...

everyone

👀 🤣 😅

Seriously, looking at your changes that was quite an effort - well done!

dlsniper commented 2 weeks ago

@brandonrising and everyone else who contributed to that PR, Thank you!

MDsniper commented 2 weeks ago

So today I saw flux in invoke to downlaod but I can't select it to use:

Screenshot 2024-08-28 192912

MDsniper commented 2 weeks ago

If any one knows how to use it please let me know

MDsniper commented 2 weeks ago

https://github.com/invoke-ai/InvokeAI/releases/tag/v4.2.9rc1

image