Open rodrigoandrigo opened 4 months ago
i am unsure of what directml is, appears to be an alternative to --use-cuda; but these don't work with cuda, either, same errors - not iterable, "startswith".
hope that helps tracking down the issue!
16:01:05-437841 DEBUG Text2Video: model={'name': 'Potat v1', 'path': 'camenduru/potat1', 'params': [24, 1024, 576]}
defaults=True frames=21, video=MP4 duration=2 loop=True pad=1 interpolate=0
16:01:05-439840 ERROR Exception: argument of type 'CheckpointInfo' is not iterable
16:01:05-440840 ERROR Arguments: args=('task(4tglye2wwa8ff2n)', '', ' there are trees and foliage visible in the
background on the right side, sunlight casts shadows across the scene creating a contrast
between light and dark areas, photograph taken during daytime. <lora:chas-notext-42e:1.4>',
'child, kid, baby, infant, low quality, ugly', [], 70, 20, 31, True, False, False, False, 1, 1,
7, 6, 0.7, 0, 0.5, 1, 1, -1.0, -1.0, 0, 0, 0, 253, 450, False, 0.3, 1, 1, 'Add with forward',
'None', False, 20, 0, 0, 20, 0, '', '', 0, 0, 0, 0, False, 4, 0.95, False, 0.6, 1, '#000000',
0, [], 20, 1, 'None', 'None', 'None', 'None', 0.5, 0.5, 0.5, 0.5, None, None, None, None,
False, False, False, False, 0, 0, 0, 0, 1, 1, 1, 1, None, None, None, None, False, '', False,
0, '', [], 0, '', [], 0, '', [], False, True, False, True, False, False, False, 0, 'None', [],
'FaceID Base', True, True, 1, 1, 1, 0.5, True, 'person', 1, 0.5, True, 'None', 16, 'None', 1,
True, 'None', 2, True, 1, 0, True, 'none', 3, 4, 0.25, 0.25, 1, -0.5, 0, 'THUDM/CogVideoX-2b',
'DDIM', 49, 6, 'balanced', True, 'None', 8, True, 1, 0, None, None, '', 0.5, 5, None, '', 0.5,
5, None, 3, 1, 1, 0.8, 8, 64, True, 0.65, True, False, 1, 1, 1, '', True, 0.5, 600.0, 1.0,
True, None, 1, 0, 0, 0, 0, 0, 0, 0, 1, 1, 1, 0.5, 0.5, 'OpenGVLab/InternVL-14B-224px', False,
0.7, 1.2, 128, False, False, 'positive', 'comma', 0, False, False, '', 'None', '', 1, '',
'None', 1, True, 10, 'Potat v1', True, 21, 'MP4', 2, True, 1, 0, 0, '', [], 0, '', [], 0, '',
[], False, True, False, True, False, False, False, 0) kwargs={}
16:01:05-445841 ERROR gradio call: TypeError
╭───────────────────────────────────────── Traceback (most recent call last) ──────────────────────────────────────────╮
│ D:\opt\automatic\modules\call_queue.py:31 in f │
│ │
│ 30 │ │ │ try: │
│ ❱ 31 │ │ │ │ res = func(*args, **kwargs) │
│ 32 │ │ │ │ progress.record_results(id_task, res) │
│ │
│ D:\opt\automatic\modules\txt2img.py:92 in txt2img │
│ │
│ 91 │ p.state = state │
│ ❱ 92 │ processed = scripts.scripts_txt2img.run(p, *args) │
│ 93 │ if processed is None: │
│ │
│ D:\opt\automatic\modules\scripts.py:502 in run │
│ │
│ 501 │ │ if hasattr(script, 'run'): │
│ ❱ 502 │ │ │ processed = script.run(p, *parsed) │
│ 503 │ │ else: │
│ │
│ D:\opt\automatic\scripts\text2video.py:75 in run │
│ │
│ 74 │ │ │
│ ❱ 75 │ │ if model['path'] in shared.opts.sd_model_checkpoint: │
│ 76 │ │ │ shared.log.debug(f'Text2Video cached: model={shared.opts.sd_model_checkpoint}') │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
TypeError: argument of type 'CheckpointInfo' is not iterable
@genewitch i've fixed your issue, but this is totally different - please check when posting issues. a) error is completely different, b) model used is completely different. issue is about svd, you're posting about t2v script.
I don't really want to argue. i tried all three of the text-to-video that the OP said had that error and saw the same "CheckpointInfo is not iterable" as well as the error ending with "object has no attribute 'startswith'".
These diverge, i assume, because of the different backends or whatever, directml vs cuda, but the error has the same verbiage and lines 31 and 75 are in common in errors.
Sorry. I was trying to give context.
original error is not in the same module, even if the error may look the same to you. issue was created for SVD - you're tring T2V - very different. anyhow, its fixed in dev branch and will be included in the next release.
Issue Description
I tried using the 3 video generator scripts with directml, but none of them worked
Text-to-Video in Text models: Potat v1, ZeroScope v2 Dark, ModelScope 1.7b
Image-to-Video in Image models: VGen
Stable Video Diffusion in Image models: SVD XT 1.1
Version Platform Description
2024-07-16 12:38:07,164 | sd | INFO | launch | Starting SD.Next 2024-07-16 12:38:07,169 | sd | INFO | installer | Logger: file="C:\StabilityMatrix\Data\Packages\SD.Next\sdnext.log" level=INFO size=899852 mode=append 2024-07-16 12:38:07,171 | sd | INFO | installer | Python version=3.10.11 platform=Windows bin="C:\StabilityMatrix\Data\Packages\SD.Next\venv\Scripts\python.exe" venv="C:\StabilityMatrix\Data\Packages\SD.Next\venv" 2024-07-16 12:38:07,474 | sd | INFO | installer | Version: app=sd.next updated=2024-07-10 hash=2ec6e9ee branch=master url=https://github.com/vladmandic/automatic/tree/master ui=main 2024-07-16 12:38:08,050 | sd | INFO | launch | Platform: arch=AMD64 cpu=AMD64 Family 25 Model 80 Stepping 0, AuthenticAMD system=Windows release=Windows-10-10.0.22631-SP0 python=3.10.11 2024-07-16 12:38:08,053 | sd | DEBUG | installer | Torch allocator: "garbage_collection_threshold:0.80,max_split_size_mb:512" 2024-07-16 12:38:08,054 | sd | DEBUG | installer | Torch overrides: cuda=False rocm=False ipex=False diml=True openvino=False 2024-07-16 12:38:08,054 | sd | DEBUG | installer | Torch allowed: cuda=False rocm=False ipex=False diml=True openvino=False 2024-07-16 12:38:08,054 | sd | INFO | installer | Using DirectML Backend 2024-07-16 09:35:37,397 | sd | DEBUG | launch | Starting module: <module 'webui' from 'C:\StabilityMatrix\Data\Packages\SD.Next\webui.py'> 2024-07-16 09:35:37,397 | sd | INFO | launch | Command line args: ['--medvram', '--autolaunch', '--use-directml'] medvram=True autolaunch=True use_directml=True 2024-07-16 09:35:37,399 | sd | DEBUG | launch | Env flags: [] 2024-07-16 09:37:38,790 | sd | INFO | loader | Load packages: {'torch': '2.3.1+cpu', 'diffusers': '0.29.1', 'gradio': '3.43.2'} 2024-07-16 09:37:42,767 | sd | DEBUG | shared | Read: file="config.json" json=35 bytes=1548 time=0.000 2024-07-16 09:37:42,821 | sd | INFO | shared | Engine: backend=Backend.DIFFUSERS compute=directml device=privateuseone:0 attention="Dynamic Attention BMM" mode=no_grad 2024-07-16 09:37:42,979 | sd | INFO | shared | Device: device=AMD Radeon RX 6600M n=1 directml=0.2.2.dev240614 2024-07-16 09:37:42,987 | sd | DEBUG | shared | Read: file="html\reference.json" json=45 bytes=25986 time=0.006 2024-07-16 09:38:04,704 | sd | DEBUG | init | ONNX: version=1.18.1 provider=DmlExecutionProvider, available=['AzureExecutionProvider', 'CPUExecutionProvider']
Relevant log output
Backend
Diffusers
UI
Standard
Branch
Master
Model
StableDiffusion 1.5
Acknowledgements