shadowcz007 / comfyui-mixlab-nodes

Workflow-to-APP、ScreenShare&FloatingVideo、GPT & 3D、SpeechRecognition&TTS
https://mixlabnodes.com
MIT License
1.12k stars 67 forks source link
3d chatgpt comfyui lcm-lora real-time screenshare tts

适配了最新版 comfyui 的 py3.11 ,torch 2.3.1+cu121 Mixlab nodes discord

商务合作请联系 389570357@qq.com For business cooperation, please contact email 389570357@qq.com

Her 的DEMO页面

最新

This is the int4 quantized version of MiniCPM-V 2.6. Running with int4 version would use lower GPU memory (about 7GB).

alt text

相关插件推荐

comfyui-liveportrait

Comfyui-ChatTTS

comfyui-sound-lab

comfyui-Image-reward

comfyui-ultralytics-yolo

comfyui-moondream

🚀🚗🚚🏃 Workflow-to-APP

Example:

APP-JSON:

暂时支持 9 种节点作为界面上的输入节点:Load Image、VHSLoadVideo、CLIPTextEncode、PromptSlide、TextInput、Color、FloatSlider、IntNumber、CheckpointLoaderSimple、LoraLoader

输出节点:PreviewImage 、SaveImage、ShowTextForGPT、VHS_VideoCombine、PromptImage

seed 统一输入控件,支持:SamplerCustom、KSampler

配套ps 插件

如果遇到上传图片不成功,请检查下:局域网或者是云服务,请使用 https,端口 8189 这个服务( 感谢 @Damien 反馈问题)

If you encounter difficulties in uploading images, please check the following: for local network or cloud services, please use HTTPS and the service on port 8189. (Thanks to @Damien for reporting the issue.)

🏃🚗🚚🚀 Real-time Design

ScreenShareNode & FloatingVideoNode. Now comfyui supports capturing screen pixel streams from any software and can be used for LCM-Lora integration. Let's get started with implementation and design! 💻🌐

screenshare

https://github.com/shadowcz007/comfyui-mixlab-nodes/assets/12645064/e7e77f90-e43e-410a-ab3a-1952b7b4e7da

ScreenShareNode & FloatingVideoNode

!! Please use the address with HTTPS (https://127.0.0.1).

SpeechRecognition & SpeechSynthesis

f

Voice + Real-time Face Swap Workflow

text-to-audio

GPT

Support for calling multiple GPTs.Local LLM 、 ChatGPT、ChatGLM3 、ChatGLM4 , Some code provided by rui. If you are using OpenAI's service, fill in https://api.openai.com/v1 . If you are using a local LLM service, fill in http://127.0.0.1:xxxx/v1 . Azure OpenAI:https://xxxx.openai.azure.com

LLM_base_workflow

Prompt

PromptSlide

randomPrompt

randomPrompt

ClipInterrogator

add clip-interrogator

PromptImage & PromptSimplification,Assist in simplifying prompt words, comparing images and prompt word nodes.

ChinesePrompt && PromptGenerate,中文 prompt 节点,直接用中文书写你的 prompt

Layers

A new layer class node has been added, allowing you to separate the image into layers. After merging the images, you can input the controlnet for further processing.

The composite images node overlays a foreground image onto a background image at specified positions and scales, with optional blending modes and masking capabilities. position : 'overall',"center_center","left_bottom","center_bottom","right_bottom","left_top","center_top","right_top"

layers

poster

3D

workflow

workflow

Image

LoadImagesToBatch

Upload multiple images for batch input into the IP adapter.

LoadImagesFromLocal

Monitor changes to images in a local folder, and trigger real-time execution of workflows, supporting common image formats, especially PSD format, in conjunction with Photoshop.

watch

workflow-4

LoadImagesFromURL

Conveniently load images from a fixed address on the internet to ensure that default images in the workflow can be executed.

TextImage

下载字体放到 custom_nodes/comfyui-mixlab-nodes/assets/fonts

MiniCPM-VQA Simple

This is the int4 quantized version of MiniCPM-V 2.6. Running with int4 version would use lower GPU memory (about 7GB).

模型

alt text

Style

Apply VisualStyle Prompting , Modified from ComfyUI_VisualStylePrompting

StyleAligned , Modified from style_aligned_comfy

Utils

The Color node provides a color picker for easy color selection, the Font node offers built-in font selection for use with TextImage to generate text images, and the DynamicDelayByText node allows delayed execution based on the length of the input text.

Other Nodes

main main2

workflow-1

TransparentImage

TransparentImage

FeatheredMask、SmoothMask

Add edges to an image.

FeatheredMask

LaMaInpainting(需要手动安装)

from simple-lama-inpainting

rembgNode

"briarmbg","u2net","u2netp","u2net_human_seg","u2net_cloth_seg","silueta","isnet-general-use","isnet-anime"

briarmbg model was developed by BRlA Al and can be used as an open-source model for non-commercial purposes

Enhancement

*** If not needed, you can comment out app.showMissingNodesError in the ui_mixlab.js file.

help

node-not-found

右键菜单支持 text-to-text,方便对 prompt 词补全,支持云LLM或者是本地LLM。 The right-click menu supports text-to-text conversion, facilitating prompt word completion, and supports cloud LLMs or local LLMs.

Local LLM API example:http://localhost:1234/v1

alt text

Models

Download rembg Models,move to:models/rembg

Download lama, move to : models/lama

Download Salesforce/blip-image-captioning-base, move to :models/clip_interrogator/Salesforce/blip-image-captioning-base

Download succinctly/text2image-prompt-generator,move to:models/prompt_generator/text2image-prompt-generator

Download Helsinki-NLP/opus-mt-zh-en,move to:models/prompt_generator/opus-mt-zh-en

Installation

manually install, simply clone the repo into the custom_nodes directory with this command:

cd ComfyUI/custom_nodes

git clone https://github.com/shadowcz007/comfyui-mixlab-nodes.git

Install the requirements:

run directly:

cd ComfyUI/custom_nodes/comfyui-mixlab-nodes
install.bat

or install the requirements using:

../../../python_embeded/python.exe -s -m pip install -r requirements.txt

If you are using a venv, make sure you have it activated before installation and use:

pip3 install -r requirements.txt

Chinese community

访问 www.mixcomfy.com,获得更多内测功能,关注微信公众号:Mixlab 无界社区

File / LoadImagesFromPath SaveImageToLocal LoadImagesFromURL

discussions:

discussions

Star History Chart