zmwv823 / ComfyUI_Anytext

Unofficial custom_node for AnyText: https://github.com/tyxsspa/AnyText and Glyph-ByT5: https://github.com/AIGText/Glyph-ByT5 and JoyType: https://github.com/jdh-algo/JoyType
https://127.0.0.1:8888
Apache License 2.0
8 stars 1 forks source link
anytext comfyui comfyui-nodes glyph-byt5 joytype

Look at the node tooltip for instruction.

1、AnyText: Unofficial custom_node for AnyText: Multilingual Visual Text Generation And Editing

Improved custom_node from my older custom_node (repo deleted for too much bugs).

AnyText Checkpoint: select Auto_Download from huggingface or manual download from huggingface or modelscope.

Huggingface:

Clip model: select Auto_Download from huggingface or manual download or git clone from huggingface or modelscope into ComfyUI\models\text_encoders.

Huggingface:

Font: select Auto_Download from huggingface or manual download from huggingface or modelscope or use any other fonts.

Huggingface:

Zh to En Translators:

T5: Auto_Download from huggingface or manual download or git clone from huggingface into ComfyUI\models\prompt_generator\models--utrobinmv--t5_translate_en_ru_zh_base_200.

Workflow in workflow dir:

2、Glyph-ByT5: Unofficial custom_node for Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering

Limitations: background result worse than original SDXL checkpoint, image resolution locked at 1024x1024, input mask and image aspect ratio must be 1:1.

Place Glyph-ByT5 checkpoints in ComfyUI\custom_nodes\ComfyUI_Anytext\Image_Generation\Glyph_SDXL\checkpoints

Place google/byt5-small text_encoder into ComfyUI\models\text_encoders or select Auto_Download from huggingface.

For sdxl checkpoints, download original_config_yaml and inpaint_original_config_yaml into ComfyUI\models\configs.

Workflow in workflow dir:

3、JoyType: Unofficial custom_node for JoyType: A Robust Design for Multilingual Visual Text Creation

It's a typical canny controlnet implementation by diffusers library.

Comfy sample workflow recommended, sd1.5、sd2.1、sdxl canny works.

For JoyType controlnet, download from https://huggingface.co/jdh-algo/JoyType-v1-1M into ComfyUI\models\controlnet. It's a diffusers format canny controlnet, compitable with comfy sampler.

Workflow in workflow dir: