search

Nerogar / OneTrainer

OneTrainer is a one-stop solution for all your stable diffusion training needs.
GNU Affero General Public License v3.0
1.73k stars 146 forks source link

[Bug]: Unable to load trained SD3 model in ComfyUI #405

Open Tophness opened 3 months ago

Tophness commented 3 months ago

What happened?

My sample previews during training are fine, but when I try to use my trained SD3 model in comfyui, I get outputs with only coloured blobs. I'm using the official default workflow from stability which works fine for the official model. I've tried including the text encoder and only feeding the single model in, I've tried excluding them and using the originals, I've tried using the same sampler and scheduler that onetrainer uses, nothing changes. Anyone else getting this?

img

These are my OneTrainer settings: ot1 ot2

Tophness commented 3 months ago

The same model works fine in the latest Automatic1111 with Euler, but I get the coloured blobs if I use DPM++ SDE. In comfyui, no samplers work.

quzopl commented 3 months ago

I get the coloured blobs if I use DPM++ SDE>

because DPM++ SDE does not work with SD3

Tophness commented 3 months ago

I get the coloured blobs if I use DPM++ SDE>

because DPM++ SDE does not work with SD3

Yeah I know, but ComfyUI blobs resemble the outputs of Automatic1111 using DPM++ SDE, regardless of whether it's using Euler or any other sampler, so it might be useful in diagnosing what the ComfyUI issue is.

This only happens on models trained with OneTrainer. Switching to the SD3 base model or other finetunes from civit, the outputs are normal again.

O-J1 commented 2 weeks ago

@Nerogar Thoughts? My initial impression is this is once again a standardisation issue