[Bug]: Enabling HyperTile U-Net causes the reference controlnet to stop working

[franklydegenerate]

Is there an existing issue for this?

• [X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

With HyperTile U-Net enabled, the reference controlnet does not work. If you only enable HyperTile VAE, it's fine. I tested it, and it's only U-Net that causes problems.

Steps to reproduce the problem

1. Go to controlnet, enable reference only. Make sure that HyperTile U-Net is enabled.
2. Include an image for reference only
3. Click 'generate'
4. The generation fails
5. A long error message is posted to the cmd

What should have happened?

Hypertile U-Net should not affect the reference controlnet

Commit where the problem happens

webui: version: [v1.7.0] • python: 3.10.6  •  torch: 2.0.1+cu118  •  xformers: 0.0.20  •  gradio: 3.41.2 controlnet: [416c3450]

What browsers do you use to access the UI ?

Google Chrome

Command Line Arguments

--xformers

List of enabled extensions

• CFG_Rescale_webui,
• CharacteristicGuidanceWebUI,
• a1111-sd-webui-tagcomplete,
• adetailer, clip-interrogator-ext,
• model-keyword,
• multidiffusion-upscaler-for-automatic1111,
• sd-canvas-editor,
• sd-civitai-browser-plus,
• sd-model-preview-xd,
• sd-webui-cleaner,
• sd-webui-controlnet,
• sd-webui-depth-lib,
• sd-webui-infinite-image-browsing,
• sd-webui-inpaint-anything,
• sd-webui-llul,
• sd-webui-openpose-editor,
• sd-webui-prompt-all-in-one,
• sd-webui-reactor,
• sd-webui-regional-prompter,
• sd-civitai-extension,
• sd_delete_button,
• sdwebui-nai-api,
• stable-diffusion-webui-depthmap-script,
• stable-diffusion-webui-promptgen,
• stable-diffusion-webui-rembg,
• stable-diffusion-webui-two-shot,
• ultimate-upscale-for-automatic1111

Console logs

https://pastebin.com/0XK8Q2Tm

Additional information

No response

[negu63]

I'm having the same problem.

RuntimeError: Sizes of tensors must match except in dimension 2. Expected size 4096 but got size 2048 for tensor number 1 in the list.

Webui version: v1.7.0 python: 3.10.13 torch: 2.0.1+cu118 xformers: 0.0.20 gradio: 3.41.2 checkpoint: 1449e5b0b9 arguments: --xformers --xformers-flash-attention --no-half-vae

Controlnet version: v1.1.440 checkpoint: 9a5f2883

Detail Information

[78Alpha]

Ran into this as well but it happens whether hypertile is on or off.

Disabling hypertile forced an override to activate it again, turning that off makes it work again.