guoqincode / Open-AnimateAnyone

Unofficial Implementation of Animate Anyone
2.89k stars 233 forks source link

train 13000 step, texture is much different from reference image #63

Closed VisionU closed 8 months ago

VisionU commented 8 months ago

In first stage, In oder to train model easy, we remove posenet, use VAE encoder instead(cat with noise like in-painting SD). Now it train 13000 step, texture is much different from reference image, is this correct? or we just need to waiting for more steps? image image

guoqincode commented 8 months ago

I don't think it's normal... It looks scary.

guoqincode commented 8 months ago

I will release the pre-trained model as soon as possible, please be patient, it may not take a few days.

VisionU commented 8 months ago

I will release the pre-trained model as soon as possible, please be patient, it may not take a few days. @guoqincode OK, I train it use 512x768, use r.clear(), w.clear(), can you give some advise for this bad result? data, or code?

guoqincode commented 8 months ago

If it's a texture issue, I have two suggestions.

  1. Train more steps
  2. Check if unet is updated
VisionU commented 8 months ago

If it's a texture issue, I have two suggestions.

  1. Train more steps
  2. Check if unet is updated

Thank you ~

sizhky commented 8 months ago

Check if unet is updated Can you elaborate @guoqincode

renrenzsbbb commented 7 months ago

If it's a texture issue, I have two suggestions.

  1. Train more steps
  2. Check if unet is updated

Thank you ~

Can you fix it? If can, can you give some advices?