chaosaiart / Chaosaiart-Nodes

Use AI to Animate - ComfyUI Custom Nodes include IMG Caches, Switches, Prompt & Checkpoint changer...
https://chaosaiart.de/nodes/
74 stars 10 forks source link
ai animation comfyui comfyui-nodes comfyui-workflow stable-diffusion









Use Case:
LowVRAM Animation


Examples
txt2img




txt2img





Work in Progress.


Further Use
Simplified workflow, VAE inclusion in KSampler
Workflow automation, e.g., changing checkpoints
Logical process for testing elements like Controlnet
Rethinking workflows with switches


Importen
This node is based on frame-to-frame generation (img after img).
This means it is VRAM efficient and suitable for GPUs with low VRAM.

Additional: Chaosaiart-Node is in the early phase,
more nodes will be added + Bug fixes + changes.



Install
Manuel ComfyUI Manager


1. Install ComfyUI
2. Download Chaosaiart-Nodes
3. Unzip Chaosaiart-Nodes with 7zip
4. Grab the Unzipped "Chaosaiart-Nodes" folder
5. go into ComfyUI Folder, then "../comfyUI/custom_nodes/" place it in.


6. Windows:
Use the Install_windows file in the "Chaosaiart-Nodes" folder
Linux: pip install opencv-python & pip install tqdm If you are using a virtual environment (venv), make sure it is activated before installation.

Open ComfyUI, Load or Drag & Drop one of the workflows.



1. Install ComfyUI
2. Install ComfyUI Manager
3. Open Manager, Use "Install via Git URL".
4. Command: https://github.com/chaosaiart/Chaosaiart-Nodes
Open ComfyUI, Load or Drag & Drop one of the workflows.


Workflows
Install Install Install



Workflows



Change Checkpoint, you can specify when.
1x Frame = 1x generated Img / Batch




Change Prompt, you can specify when.
1x Frame = 1x generated Img / Batch




Change Checkpoint & Prompt, you can specify when.
1x Frame = 1x generated Img / Batch




Basic img2img Batch Loader
Select folder, Each generation uses the next image.
You also can Repeat Img.


Basic Controlnet Batch Loader
Select folder, Each generation uses the next image.
You also can Repeat Img.




Splitt Video in to Frames / img



Stitching Image to Video


Stitching Image to Gif



First Step for Animation
Cache a Img for the next generate, in this Case Img2img. My Promptchanger workflow has been implemented. Prompt Changer




Change Controlnet Settings by Counting.
1x Frame = 1x generated Img / Batch = Step
You will need Canny Model



Save and Load your Prompt + Simple Workflow.
For Loading & Saving Text you need to Install this Custom Node



Using Any-Switch to control any input at any time.



Utilize arrays to enhance the organization of your workspace, or swiftly switch between processes to test things.



idrirap has written a great Lora Auto-Trigger-Words Custom Node. Through this, I found out that all tags are included in the metadata. From now on, all tags and their frequency of use will be output by Lora via Info.

How to Use Loras:




usable in all 🔶Chaosaiart prompt fields.



Change Contrast, Color, Brightness, Red, Green, Blue.



Change Contrast, Color, Brightness, Red, Green, Blue.





Workflows


Animation:
This workflow has integrated the cache of the Cache Workflow in KSampler.
Additionally, KSampler has been modified to yield better results for animations.
For example, the method "Fixed 0.5" has been optimized for checkpoint sd1.5.
Afterwards, you must stitch the images into a video using img2video Basic Workflow


Same workflow as txt2video, but with image input.





Workflows


In this workflow, the 🔶 Ksampler txt & img2video v1 has been dissected into its individual components.
This allows you to see what it consists of and enables you to adjust the values yourselves.


Nodes
🔶 Image
Nodes Nodes

🔶 Ksampler
Nodes Nodes Nodes Nodes

🔶 Cache
Nodes Nodes Nodes

🔶 Logic
Nodes

🔶 Prompt
Nodes Nodes

🔶 Checkpoint
Nodes Nodes Nodes

🔶 Lora
Nodes

🔶 Controlnet
Nodes

🔶 Special
Nodes

🔶 Switch
Nodes Nodes



Nodes
Open Buymeacoffee

Open Paypal

Open Patreon



Nodes
Credits to pythongosssss for their custom node without it, my info display would have been more challenging.
Credits to Idrirap for their custom node and the idea of extracting tags from the metadata of Lora.


https://chaosaiart.de & https://chaosaiart.com