Mikubill / sd-webui-controlnet

WebUI extension for ControlNet
GNU General Public License v3.0
16.41k stars 1.9k forks source link

Create Monster #2923

Closed swalker19 closed 1 month ago

swalker19 commented 1 month ago

Hi there, are you able to assist with adding new models to ControlNet?

On Tue, May 21, 2024 at 11:21 AM Chenlei Hu @.***> wrote:

Closed #2923 https://github.com/Mikubill/sd-webui-controlnet/pull/2923.

— Reply to this email directly, view it on GitHub https://github.com/Mikubill/sd-webui-controlnet/pull/2923#event-12881813858, or unsubscribe https://github.com/notifications/unsubscribe-auth/BIULEL2ZBHH3B6SF57374S3ZDNQ7JAVCNFSM6AAAAABIBZJKJOVHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJSHA4DCOBRGM4DKOA . You are receiving this because you authored the thread.Message ID: @.*** com>

-- CODE AND THEORY

Ad Age Business Transformation Agency of the Year

Scott Walker Production Designer

New York One World Trade Center 69th Floor New York, NY 10007

O: 212.358.0717 www.codeandtheory.com LinkedIn https://www.linkedin.com/company/code-and-theory | X https://x.com/codeandtheory | Instagram https://www.instagram.com/codeandtheory

huchenlei commented 1 month ago

ControlNet now does not use yaml to specify model structure. You can find model loading logic here: https://github.com/Mikubill/sd-webui-controlnet/blob/main/scripts/controlnet_model_guess.py

swalker19 commented 1 month ago

Hi Chenlei, so are you saying it's no longer possible to use the monster model in ControlNet?

On Tue, May 21, 2024 at 11:52 AM Chenlei Hu @.***> wrote:

ControlNet now does not use yaml to specify model structure. You can find model loading logic here:

https://github.com/Mikubill/sd-webui-controlnet/blob/main/scripts/controlnet_model_guess.py

— Reply to this email directly, view it on GitHub https://github.com/Mikubill/sd-webui-controlnet/pull/2923#issuecomment-2122937385, or unsubscribe https://github.com/notifications/unsubscribe-auth/BIULEL66B3WIV6HZWTBF7ODZDNUS7AVCNFSM6AAAAABIBZJKJOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRSHEZTOMZYGU . You are receiving this because you authored the thread.Message ID: @.***>

-- CODE AND THEORY

Ad Age Business Transformation Agency of the Year

Scott Walker Production Designer

New York One World Trade Center 69th Floor New York, NY 10007

O: 212.358.0717 www.codeandtheory.com LinkedIn https://www.linkedin.com/company/code-and-theory | X https://x.com/codeandtheory | Instagram https://www.instagram.com/codeandtheory

huchenlei commented 1 month ago

If the model is in any category we supported, it should automatically load without you adding extra yaml file. If it is not recognized, you need to add an entry here: https://github.com/Mikubill/sd-webui-controlnet/blob/7b4cdea2a44dda6eb042eed5af1439726a4c5e1a/scripts/controlnet_model_guess.py#L20-L73 and make necessary adjustment in the detection code.

swalker19 commented 1 month ago

So I'm wondering if the issue is that the file I want to use is too large, it's 722.6mb. But the tutorial I was following managed to use it, do you happen to know if there's a solution to make it usable?

By the way thank you so much for any assistance you can provide, I'm a graphic designer and don't have much in the way of programming knowledge so I very much appreciate your help.

On Tue, May 21, 2024 at 3:24 PM Chenlei Hu @.***> wrote:

If the model is in any category we supported, it should automatically load without you adding extra yaml file. If it is not recognized, you need to add an entry here: https://github.com/Mikubill/sd-webui-controlnet/blob/7b4cdea2a44dda6eb042eed5af1439726a4c5e1a/scripts/controlnet_model_guess.py#L20-L73 and make necessary adjustment in the detection code.

— Reply to this email directly, view it on GitHub https://github.com/Mikubill/sd-webui-controlnet/pull/2923#issuecomment-2123295516, or unsubscribe https://github.com/notifications/unsubscribe-auth/BIULEL6MM234YKVMFFVFXC3ZDONPBAVCNFSM6AAAAABIBZJKJOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRTGI4TKNJRGY . You are receiving this because you authored the thread.Message ID: @.***>

-- CODE AND THEORY

Ad Age Business Transformation Agency of the Year

Scott Walker Production Designer

New York One World Trade Center 69th Floor New York, NY 10007

O: 212.358.0717 www.codeandtheory.com LinkedIn https://www.linkedin.com/company/code-and-theory | X https://x.com/codeandtheory | Instagram https://www.instagram.com/codeandtheory

huchenlei commented 1 month ago

700MB is the typical SD15 ControlNet model in half precision (fp16). The full precision model will be ~1.4GB, and SDXL models will even be bigger.

Size is not the issue. Can you share a link to the model you want to use?

swalker19 commented 1 month ago

Yea for sure, here's the link:

https://huggingface.co/monster-labs/control_v1p_sd15_qrcode_monster/tree/main

Based on the tutorial I followed, I downloaded the .safetensors and .yaml files.

On Tue, May 21, 2024 at 4:14 PM Chenlei Hu @.***> wrote:

700MB is the typical SD15 ControlNet model in half precision (fp16). The full precision model will be ~1.4GB, and SDXL models will even be bigger.

Size is not the issue. Can you share a link to the model you want to use?

— Reply to this email directly, view it on GitHub https://github.com/Mikubill/sd-webui-controlnet/pull/2923#issuecomment-2123368506, or unsubscribe https://github.com/notifications/unsubscribe-auth/BIULEL372TUU6TGMOQ6F2G3ZDOTLPAVCNFSM6AAAAABIBZJKJOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRTGM3DQNJQGY . You are receiving this because you authored the thread.Message ID: @.***>

-- CODE AND THEORY

Ad Age Business Transformation Agency of the Year

Scott Walker Production Designer

New York One World Trade Center 69th Floor New York, NY 10007

O: 212.358.0717 www.codeandtheory.com LinkedIn https://www.linkedin.com/company/code-and-theory | X https://x.com/codeandtheory | Instagram https://www.instagram.com/codeandtheory

huchenlei commented 1 month ago

You should be able to directly use it without any code changes to this extension.

swalker19 commented 1 month ago

Next thought is maybe it's a permissions issue, is this where I should be adding those files?

On Tue, May 21, 2024 at 4:20 PM Chenlei Hu @.***> wrote:

You should be able to directly use it without any code changes to this extension.

— Reply to this email directly, view it on GitHub https://github.com/Mikubill/sd-webui-controlnet/pull/2923#issuecomment-2123375895, or unsubscribe https://github.com/notifications/unsubscribe-auth/BIULEL4JJORK3OUWU46WUNLZDOT7DAVCNFSM6AAAAABIBZJKJOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRTGM3TKOBZGU . You are receiving this because you authored the thread.Message ID: @.***>

-- CODE AND THEORY

Ad Age Business Transformation Agency of the Year

Scott Walker Production Designer

New York One World Trade Center 69th Floor New York, NY 10007

O: 212.358.0717 www.codeandtheory.com LinkedIn https://www.linkedin.com/company/code-and-theory | X https://x.com/codeandtheory | Instagram https://www.instagram.com/codeandtheory

huchenlei commented 1 month ago

You can follow guide here: https://github.com/Mikubill/sd-webui-controlnet/wiki/Model-download

swalker19 commented 1 month ago

Ok there must be something I'm missing because I can't seem to get that model to show up in Stable Diffusion. I downloaded the models correctly so I have them on my system but can't seem to get them to become accessible within ControlNet.

On Tue, May 21, 2024 at 4:26 PM Chenlei Hu @.***> wrote:

You can follow guide here: https://github.com/Mikubill/sd-webui-controlnet/wiki/Model-download

— Reply to this email directly, view it on GitHub https://github.com/Mikubill/sd-webui-controlnet/pull/2923#issuecomment-2123384765, or unsubscribe https://github.com/notifications/unsubscribe-auth/BIULELZ6FTI3XZIRVOOMSOTZDOUVXAVCNFSM6AAAAABIBZJKJOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRTGM4DINZWGU . You are receiving this because you authored the thread.Message ID: @.***>

-- CODE AND THEORY

Ad Age Business Transformation Agency of the Year

Scott Walker Production Designer

New York One World Trade Center 69th Floor New York, NY 10007

O: 212.358.0717 www.codeandtheory.com LinkedIn https://www.linkedin.com/company/code-and-theory | X https://x.com/codeandtheory | Instagram https://www.instagram.com/codeandtheory