volotat / SD-CN-Animation

This script allows to automate video stylization task using StableDiffusion and ControlNet.
MIT License
809 stars 63 forks source link

An exception occurred while trying to process the frame: list index out of range #73

Open rendez2k opened 1 year ago

rendez2k commented 1 year ago

Trying this on a Rundiffusion pod and I get "An exception occurred while trying to process the frame: list index out of range"

image

kuyin commented 1 year ago

I met this error too.

havok2-htwo commented 1 year ago

+1

NameisNam commented 1 year ago

ok so this also happened to me. I removed all the ControlNet models and It worked again. (But it looked the ControlNet model that I chose before still running)

cbolich commented 1 year ago

at least for me:

Works without --api --listen won't work if these are enabled

Pythonpa commented 1 year ago

em,looks like you should close --api command,and it worked

RMN1979 commented 1 year ago

ok so this also happened to me. I removed all the ControlNet models and It worked again. (But it looked the ControlNet model that I chose before still running)

Tell me, please, did you just delete the models CN from the models folder or did you disable CN in the extensions?

RMN1979 commented 1 year ago

Resolved: I restarted the webui-user bat file, and now the generation goes without problems, so far ...

SPotaufeux commented 1 year ago

em,looks like you should close --api command,and it worked

How do you do this ? Is there a command I should write in webui-user.bat ?

I meet this issue when I try to run ControlNet in batch mode while using CN-Animation, and after this I can't run anything if I don't fully restart the UI. However, I don't have this problem when choosing Single image.

Wtaosa commented 1 year ago

em,看起来你应该关闭--api命令,它起作用了

sorry,How should I do this?help me

SPotaufeux commented 1 year ago

Okay so apparently what works for me is : 1) full restart with no extensions 2. full restart with SD-CN-Animation extension activated 3. full restart with CN-Animation and Controlnet extensions activated (test if SD-CN-Animation works without controlnet enabled) and then 4. SD-CN-Animation works with Controlnet enabled for at least 1 run. By "full restart" I mean closing the UI and webui.bat, and run webui.bat again.

Also, apparently Controlnet is not supposed to work in "batch" run or with a pic inside. It is supposed to automatically use the pictures from the video.

Enferlain commented 1 year ago

Wanted to try the extension, but getting the same error. Even if I have no controlnet selected

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/gradio/routes.py", line 394, in run_predict
    output = await app.get_blocks().process_api(
  File "/usr/local/lib/python3.10/dist-packages/gradio/blocks.py", line 1075, in process_api
    result = await self.call_function(
  File "/usr/local/lib/python3.10/dist-packages/gradio/blocks.py", line 898, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/usr/local/lib/python3.10/dist-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/usr/local/lib/python3.10/dist-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/usr/local/lib/python3.10/dist-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/usr/local/lib/python3.10/dist-packages/gradio/utils.py", line 549, in async_iteration
    return next(iterator)
  File "/content/drive/MyDrive/sd22/stable-diffusion-webui/extensions/SD-CN-Animation/scripts/base_ui.py", line 121, in process
    yield from vid2vid.start_process(*args)
  File "/content/drive/MyDrive/sd22/stable-diffusion-webui/extensions/SD-CN-Animation/scripts/core/vid2vid.py", line 114, in start_process
    processed_frame = np.array(processed_frames[0])
IndexError: list index out of range
wushenli commented 1 year ago

me too,can not use

wushenli commented 1 year ago

An exception occurred while trying to process the frame: ,only one frame

TijuanaKez commented 1 year ago

+1

wushenli commented 1 year ago

I also have this issue - seems to happen regardless of the model selected, about 1-15 frames in. Txt to video works fine, but it's not exactly the same thing.

Wtaosa commented 1 year ago

ok ,new ideal ,play deforum,do u know deforum,it may be difficult for him of operate

wushenli commented 1 year ago

+1 no use , 3frame.no use ok ,new ideal ,play deforum,do u know deforum,it may be difficult for him of operate

Wtaosa commented 1 year ago

no u misunderstand my mean,deform is is a new generative animation plugin,u could try,it can search the cat's website。very good plugin ,but very difficult.lets go try

Wtaosa commented 1 year ago

thats a plugins. yeah

wushenli commented 1 year ago

thank you

Wtaosa commented 1 year ago

u're welcome

wushenli commented 1 year ago

I don't know where I went wrong {35O_JJVXV2GMX~{M8KW@ 9

Wtaosa commented 1 year ago

It's not your fault, this plugin originally had some compatibility issues, if you want to try it, you can download the plugin {deforum} I told you, the name of this plugin in parentheses, I used it to finish my work, at least for now, I chose the latter

Wtaosa commented 1 year ago

I don't know where I went wrong {35O_JJVXV2GMX~{M8KW@ 9

There may be tutorials on YouTube,but i cant share it with u ,beacause im in china ,so ,u know , u can go it try it.At least for now I haven't found a solution, and I chose the latter because I can make good results with him。yeah

wushenli commented 1 year ago

im in china shenzhen

Wtaosa commented 1 year ago

I don't know where I went wrong {35O_JJVXV2GMX~{M8KW@ 9

im in china shenzhen 哈哈,你去试试deforum好用。我用的很顺