replicate / comfyui-replicate

Run Replicate models as nodes in ComfyUI
https://replicate.com/explore
MIT License
34 stars 6 forks source link
ai comfy-ui comfyui comfyui-nodes replicate

comfyui-replicate

Custom nodes for running Replicate models in ComfyUI.

Take a look at the example workflows and the supported Replicate models to get started.

example-screenshot

Set your Replicate API token before running

Make sure you set your REPLICATE_API_TOKEN in your environment. Get your API tokens here, we recommend creating a new one:

https://replicate.com/account/api-tokens

To pass in your API token when running ComfyUI you could do:

On MacOS or Linux:

export REPLICATE_API_TOKEN="r8_************"; python main.py

On Windows:

set REPLICATE_API_TOKEN="r8_************"; python main.py

Direct installation

cd ComfyUI/custom-nodes
git clone https://github.com/replicate/comfyui-replicate
cd comfyui-replicate
pip install -r requirements.txt

Supported Replicate models

View the supported_models.json to see which models are packaged by default.

Update Replicate models

Simply run ./import_schemas.py to update all model nodes. The latest version of a model is used by default.

Add more models

Only models that return simple text or image outputs are currently supported. If a model returns audio, video, JSON objects or a combination of outputs, the node will not work as expected.

If you want to add more models, you can:

Roadmap

Things to investigate and add to this custom node package:

Contributing

If you add models that others would find useful, feel free to raise PRs.