search

blib-la / runpod-worker-comfy

ComfyUI as a serverless API on RunPod
GNU Affero General Public License v3.0
303 stars 208 forks source link

RunPod's Dockerless CLI #24

Open VicThor-wpp opened 9 months ago

VicThor-wpp commented 9 months ago

Hi, is there a way to implement the dockerless feature to speed up the building image process of the dockerfile?

A blog with info. https://blog.runpod.io/runpod-dockerless-cli-innovation/

TimPietrusky commented 8 months ago

@VicThor-wpp that is something we have to look into, thanks for pointing it out!

VicThor-wpp commented 8 months ago

Im actually testing with Mkdir and CP in the dockerfile to move the files from /runpod_volumes and is working. It need the detailed list of particular models for each custom_node, but in the end speed up the first run and some custom nodes dont download the models, so it avoid the crash.

brgrp commented 8 months ago

@VicThor-wpp anything you wanna share? I am probably doing the same right now hehe

voytek98 commented 7 months ago

any updates @brgrp @VicThor-wpp ?

TimPietrusky commented 6 months ago

@VicThor-wpp @brgrp @voytek98 did anyone of you came to any result?

VicThor-wpp commented 6 months ago

Yes, I make a web app for a interactive campaign for a week, I run on 3/10 runpod gpus and generate more than 20K images. Sorry I'm pretty busy right now but I'll try to make the time to make a guide.

Basically use the runpod storage to save huge models (checkpoint, ipadapters, loras, ctrlNet) and custom-modules and after with docker file install all dependencies of modules in a single pip install (tricky part) and copy all custom files (you cant change the location of all custom modules in the Comfy paths) but for a simpler workflow it should be more easy.

TimPietrusky commented 6 months ago

@VicThor-wpp that sounds great! If you ever have time, we can also jump into a video call, and you can walk me through it, and I can convert this into a guide.