Operations handling VAE / Text Encoders

[altoiddealer]

Edit- Most of these sub issues have been solved. Outstanding issues are at the top

---

I'm making this as a broad topic for the functions related to "VAE" and "Text Encoders".

According to Illyasviel, these are now one and the same in Forge.

If anyone makes comments for related issues, I'll add to the OP.

I've attempted to do these things myself, but they were over my head (except the last item).

---

Sending PNGInfo to txt2img / img2img

Module 1, Module 2, Module 3, etc - these settings should automatically populate the VAE/Text Encoders multi-select menu.

Or, in Extra Parameters field that can appear below the main sliders

---

XYZ Parameters

Currently, only "VAE" can be used via XYZ.

---

✅ Checkpoint Preferences

Original Issue

Currently no way to set default Text Encoders for checkpoints.

---

✅ API override_settings

Original Issue

Ideally, a `list` of modules (VAEs and Text Encoders) should be able to be provided in the `override_settings` dict. 

---

✅ Get all VAE / Text Encoders via API

Already done and merged - https://github.com/lllyasviel/stable-diffusion-webui-forge/pull/1463

Screenshot


[altoiddealer]

Added Checkpoint Preferences to the list of things that need to be updated.

@Panchovix Sorry to ping you, but I feel some of these should be a high priority fix. I've attempted a few times to make any sort of progress with resolving these, but I don't know enough backend stuff to even figure out where to begin.

• Checkpoint Preferences would be huge. It also offers some sort of solution to the next item....
• Flux via API is mainly limited by the inability to pair models with text encoders. Ideally, could specify them in the payload somehow (override settings).
• It would be very convenient to set VAE / text encoders when sending PNGInfo
• XYZ probably lowest priority but would be very nice to extend it to text encoders.

[altoiddealer]

I can confirm that Flux is working via the API.

I noticed that there is now an override_settings key where you can specify the forge_additional_modules. I updated the OP