jinxixiang / magic_animate_unofficial

An unoffical training code of Magic Animate
Apache License 2.0
35 stars 5 forks source link

run train.py error #11

Closed Wangxuefeng92 closed 9 months ago

Wangxuefeng92 commented 9 months ago

hi,sir,thank your great project!I am trying your ’train.py‘, but there exist two issues: a. the 'dwpose_conditions' from dwpose is numpy-type, but model need is torch-type b. image_prompts is not used in training interface

Is there any miss in your uploaded code?

jinxixiang commented 9 months ago

Thank you for bringing up this issue. It appears there are some version incompatibilities within the released code. I will investigate this matter and release an updated version shortly.

Wangxuefeng92 commented 9 months ago

thank you very much for your rely!!! I fixed these issues above and run this code. But unfortunatly,I got divergent result in ubc fashion dataset. Is there other problem in training?

jinxixiang commented 9 months ago

I update the train.py

This version should work normally.

The former version uses fine-grained image prompts during training, but it is unstable.

We use null text prompts in the updated version, like MagicAnimate.

Wangxuefeng92 commented 9 months ago

very appreciated for your help!thank you!

WilliamZhaoz commented 9 months ago

@Wangxuefeng92 Hi, I'd like to know do you use batch_size=1 or >1, I noticed that there are some comments in python file as "FIXME: only support train_batch_size=1".