mattyamonaca / ToonCrafter_with_SketchGuidance

This repository is an implementation that recreates the SketchGuidance feature of "ToonCrafter".
Apache License 2.0
67 stars 2 forks source link

Error: The size of tensor a (16) must match the size of tensor b (49) #3

Open jelling opened 1 month ago

jelling commented 1 month ago

When attempting to use the code to infer with a 512x320 images + video, I get this error:


  File "/workspace/ToonCrafter_with_SketchGuidance/cldm/cldm.py", line 339, in forward
    h += guided_hint
RuntimeError: The size of tensor a (16) must match the size of tensor b (49) at non-singleton dimension 0

Any ideas? Perhaps only specific resolutions are allowed? The example image and video does work for me.

My input files:

s-being cocky fbx-PIyR-0

s-being cocky fbx-PIyR-9

https://github.com/user-attachments/assets/d4dbeea4-c647-46c5-9631-deefe8ef0c46

abiyain commented 3 weeks ago

Tensor in this context is the number of frames, reduce the time/ number of frames of your reference video. This will solve the issue