ComfyUI MiniCPM-V (Unofficial Support)

Unofficial MiniCPM-V support for ComfyUI.

Important Updates

• 2024/08/09: Added support for MiniCPM-V 2.6 (16GB+ video memory required)
• 2024/05/22: Added support for MiniCPM-Llama3-V 2.5 (16GB+ video memory required)
• 2024/04/18: Added ComfyUI nodes and workflow examples

Basic Workflow

This workflow shows the basic usage on querying an image with Chinese and English.

Version 2.6 Workflow

This workflow shows the Verson 2.6's usage on querying multiple images and a video.

Installation

• Install from ComfyUI Manager (search for minicpm)

• Download or git clone this repository into the ComfyUI/custom_nodes/ directory and run:

  pip install -r requirements.txt

Download Checkpoints

All the models will be downloaded automatically, no worries.