Open tyeestudio opened 1 year ago
use gpu server to run this, getting error as following:
python3 controlnetvideo.py PXL_20230422_013745844.TS.mp4 --controlnet depth21 --prompt 'graffuturism colorful intricate heavy detailed outlines' --prompt-strength 9 --show-input --show-detector --show-motion --dump-frames '{instem}_frames/{n:08d}.png' --init-image-strength 0.4 --color-amount 0.3 --feedthrough-strength 0.001 --show-output --num-inference-steps 15 --duration 60.0 --start-time 10.0 --skip-dumped-frames '{instem}_out.mp4' /home/tyeestudio/env/lib/python3.8/site-packages/timm/models/_factory.py:114: UserWarning: Mapping deprecated model name vit_base_resnet50_384 to current vit_base_r50_s16_384.orig_in21k_ft_in1k. model = create_fn( Processing frame 0 at time 0/60.0 seconds... 0.00s elapsed, 0.00s estimated time remaining
Traceback (most recent call last):
File "controlnetvideo.py", line 871, in
ah okay it looks like you're trying to run it on an input video file 'PXL_20230422_013745844.TS.mp4' which I was using for testing that isn't part of the repo. Try replacing that in the command line arguments with the path to your own input video file to process. I'll try and update the docs with a better explanation of the examples.
As for what I am running this on during development, it's an AMD chipset PC with an Nvidia RTX 3090 Ti and a decent amount of disk and ram. This should run just fine on a macbook though, check out the diffusers docs page dedicated to running on Apple Silicon hardware.
ah okay it looks like you're trying to run it on an input video file 'PXL_20230422_013745844.TS.mp4' which I was using for testing that isn't part of the repo. Try replacing that in the command line arguments with the path to your own input video file to process. I'll try and update the docs with a better explanation of the examples.
As for what I am running this on during development, it's an AMD chipset PC with an Nvidia RTX 3090 Ti and a decent amount of disk and ram. This should run just fine on a macbook though, check out the diffusers docs page dedicated to running on Apple Silicon hardware.
i copied your examples/PXL_20230422_013745844.TSb_out.mp4 to PXL_20230422_013745844.TS.mp4, and run it. This is running on Nvidia GPU, not from apple silicon hardward, that is not working.
I also encountered the same error. Have you resolved it?
no
thanks for sharing. wondering what kind of hardware to run your examples ? will macbook pro works ?