s9roll7 / animatediff-cli-prompt-travel

animatediff prompt travel
Apache License 2.0
1.19k stars 105 forks source link

RuntimeError: The size of tensor a (512) must match the size of tensor b (1024) at non-singleton dimension 1` #194

Closed Tbestf closed 10 months ago

Tbestf commented 10 months ago

Can you help me take a look at the command flow? Is there any problem?

--------------Operation instructions------------------

1)python -m pip install -e .[stylize]

2)animatediff stylize create-config /data/imageToMv/model_1129/data_mp4/dome_002.mp4

3)animatediff stylize generate stylize/2023-12-05T19-30-20-sample-mistoonanime_v20 -L 16

Report an error in the third command

----------------Error message-----------------

│ │ animatediff-cli-prompt-travel/src/animatediff/models/attention.py │ │ :309 in forward │ │ │ │ 306 │ │ │ │ attention_mask=encoder_attention_mask, │ │ 307 │ │ │ │ **cross_attention_kwargs, │ │ 308 │ │ │ ) │ │ ❱ 309 │ │ │ hidden_states = attn_output + hidden_states │ │ 310 │ │ │ │ 311 │ │ # 3. Feed-forward │ │ 312 │ │ hidden_states = self.ff(self.norm3(hidden_states)) + hidden_states │

RuntimeError: The size of tensor a (512) must match the size of tensor b (1024) at non-singleton dimension 1`

Tbestf commented 10 months ago

solution: https://github.com/s9roll7/animatediff-cli-prompt-travel/issues/186 RuntimeError: The size of tensor a (64) must match the size of tensor b (32) at non-singleton dimension 4

Replace "scheduler": "k_dpmpp_sde" in the config/prompts/prompt_travel.json file with "scheduler": "euler_a".