fofr / cog-comfyui

Run ComfyUI with an API
https://replicate.com/fofr/any-comfyui-workflow
MIT License
544 stars 124 forks source link

Versioned Releases to Replicate.com? #132

Closed ansonkao closed 3 months ago

ansonkao commented 3 months ago

Have you considered releasing each new version as a separate "model" on replicate? Then developers can test before updating, instead of just hoping it doesn't break randomly while asleep.

Background: Just discovered this repo on Replicate.com. Would love to migrate over to it to take advantage of the pooling and warm boots, but there's a dealbreaker: it seems there's no way to lock down the version.

ansonkao commented 3 months ago

Wait a second - I think this might be built into replicate...

Screenshot 2024-07-24 at 11 32 49 AM

Why then do your docs say this?

image

Are you referring to how a lot of the python within the comfyui ecosystem is written to git pull from master?

fofr commented 3 months ago

This model currently updates versions so they point to the latest, see this screenshot:

Screenshot 2024-07-24 at 17 17 51

This prevents an issue where a lot of traffic gets spread across many versions and GPUs, which is inefficient.

The docs recommend ways to fix your own version because of this.

ansonkao commented 3 months ago

Gotcha, thanks. Too bad - it would be great to have the best of both worlds. Maybe in a few more months there will be enough traffic that it stays warm 24/7 across multiple consecutive versions.

ComfyUI on Google Trends:

image