ControlNet

[JohnTigue]

Now in A1111: ControlNet now supported in the A1111 WebUI! (Work in progress)

[JohnTigue]

Next-Gen New Img2img In Stable Diffusion! This Is Truly Incredible!: ControlNet requires 60GB of model storage, and tons of VRAM. Sounds like a good candidate for cloud deployment.

[JohnTigue]

Stable Diffusion ControlNet Merging Trick Explained | Depth and HED Model | ControlNet Trick

[JohnTigue]

Stable Diffusion ControlNet Extension Guess Mode Explained in Detail | ControlNet Extension

[JohnTigue]

Stable Diffusion ControlNet Resolution Explained In Detail | ControlNet Trick

[JohnTigue]

Next-Gen Multi-Controlnet Inpainting! You’Ve Never Seen This Before!

[JohnTigue]

Stable Diffusion ControlNet OpenPose Editor Trick Explained | OpenPose Trick | ControlNet. Seems we can use tools such as AfterEffects to animate a sequence of keyframes into a video. That plus ControlNet is a powerful combo.

[JohnTigue]

Multi-ControlNet and more STUNNING new features!

[JohnTigue]

COLOR CONTROL! - NEW ControlNET Method for A1111 by Olivio Sarikas

[JohnTigue]

Man! Folks are doing great work with ControlNet. It's only been on the scene for a few weeks but it is clearly very valuable in a toolset. And most timely: it works very well in combo with Blender.

From just the last day or so:

• GET PERFECT HANDS With MULTI-CONTROLNET & 3D BLENDER! This Is INSANE!
• Stable Diffusion ControlNet Guidance Start Explained | Not Just Hands | ControlNet Extension

[JohnTigue]

Stable Diffusion ControlNet Depth Library Extension | Easy hands | Controlnet Guidance Start Hands

[JohnTigue]

Character turn arounds: another cool example of ControlNet really helping get controlled results with SD: Create convincing 3D Character Rotations using Controlnet and custom openpose images!.

[JohnTigue]

How to use ControlNet in your AI Art - Stable Diffusion Tutorial 2023

[JohnTigue]

ControlNet is still so very new, but already folks are figuring out how to make it easier to use: The perfect poses made easy! Multi ControlNet, PoseX, Depth Lib, Stable Diffusion.

[JohnTigue]

And now we have ControlNet as a plug-in for Blender: AI Is Getting Out of Control in Blender | ControlNet.

[JohnTigue]

This guy is doing consistently good work. This is very similar to what the Corridor Crew has been up to. Here we get more of the how-to nitty-gritty: Flicker-Free Animations: Stable Diffusion, EBSynth & ControlNet.

[JohnTigue]

And this is explicitly aping Corridor Crew. So this technique looks like fertile ground to try implementing, if we want animations (read: cut scenes): Simple AI Animation Tutorial (Like Corridor Crew).

[JohnTigue]

This coder does consistently good SD videos. This one has ControlNet front and center: Stable Diffusion for Flawless Portraits.

[JohnTigue]

Can someone explain some of these newer controlnet models and preprocessors? Clipvision? Color? Pidinet? Binary?

[JohnTigue]

Stable Diffusion ControlNet Depth Library Extension | Easy hands | Controlnet Guidance Start Hands by CHILDISH YT

[JohnTigue]

THIS IS CRAZY!!! The perfect poses made easy! Multi ControlNet, PoseX, Depth Lib, Stable Diffusion

[JohnTigue]

Stable Diffusion ControlNet OpenPose Editor Trick Explained | OpenPose Trick | ControlNet by CHILDISH YT

[JohnTigue]

And now folks are figuring out how to use ControlNet to make facial expressions: ControlNET: NEW Face Tracking Method - BETTER Faces than ever before! by Olivio Sarikas.

[JohnTigue]

New Feature - Style2Image in ControlNet (T2I)

[JohnTigue]

Putting ControlNet on a canvas to render sketches and generate product variations

[JohnTigue]

"I made a no-nonsense fast paced tutorial from zero to advanced usage with ControlNet and Dynamic Prompting (Automatic1111)" on YouTube.

[JohnTigue]

I know you're probably tired of seeing this, but it's insane what a simple input to ControlNet can result in.

[JohnTigue]

ControlNet 1.1. installed from https://github.com/Mikubill/sd-webui-controlnet

[JohnTigue]

Note that the support libraries that are required are licensed under openrail: https://huggingface.co/lllyasviel/ControlNet-v1-1/tree/main

[JohnTigue]

Things are getting large. Scripting downloads means smaller stuff in git, and if we don't distribute the files, then their licenses do not infect the hypnowerk codebase. We make guns; under which conditions the customers fire them is a separate issue.

[JohnTigue]

ControlNet v1.1 news:

• ControlNET 1.1 - What you NEED to know!
• What is new in ControlNet1.1

[JohnTigue]

In Auto1111, ControlNet models go in ~/stable-diffusion-webui-docker/data/ControlNet/. This breaks the whole idea of a centalized Model Libary (#56). Need to work that out if there is to be an Auto1111-only cluster.

[JohnTigue]

hree months ago a document on ControlNet was published:

The speed at which Stable Diffusion is evolving is astounding and ControlNet - which is now seen as an integral part - was released to the world - just 3 months ago - February 10, 2023! Here is the original publication on arxiv.org - https://arxiv.org/abs/2302.05543

[JohnTigue]

ControlNet V1.1.171 Update : StableDiffusion

[JohnTigue]

Seems the new kid on the block is another significant component added to ControlNet: reference_only. All the usual news outlets are covering and are impressed. For example:

• YouTuber Olivio Sarikas
• YouTuber Sebastian Kamph
• A Reddit post about texturing faces (should be useful in upscaling game characters)

[JohnTigue]

Another new ControlNet feature: WOW! ControlNet 1.1 Tiles Tutorial - High Resolution for Everyone!.

[JohnTigue]

For our script which downloads all 14 ControlNet models see:

https://github.com/ManyHands/brain_trust/blob/controlnet_install_on_a1111/aws/ec2_install_controlnet_models.sh