search

seervideodiffusion / SeerVideoLDM

[ICLR 2024] Seer: Language Instructed Video Prediction with Latent Diffusion Models
16 stars 2 forks source link

Some parameters do not receive gradient. #5

Open LPY1219 opened 3 months ago

LPY1219 commented 3 months ago

Hi, Mr Gu, I am trying to retrain your model. But I found some errors: Parameters which did not receive grad for rank 1: mid_block.temporal_attentions.0.transformer_blocks.0.attn1.rotary_emb.freqs, up_blocks.3.temporal_attentions.2.transformer_blocks.0.attn1.rotary_emb.freqs, up_blocks.3.temporal_attentions.1.transformer_blocks.0.attn1.rotary_emb.freqs, up_blocks.3.temporal_attentions.0.transformer_blocks.0.attn1.rotary_emb.freqs, up_blocks.2.temporal_attentions.2.transformer_blocks.0.attn1.rotary_emb.freqs, up_blocks.2.temporal_attentions.1.transformer_blocks.0.attn1.rotary_emb.freqs, up_blocks.2.temporal_attentions.0.transformer_blocks.0.attn1.rotary_emb.freqs, up_blocks.1.temporal_attentions.2.transformer_blocks.0.attn1.rotary_emb.freqs, up_blocks.1.temporal_attentions.1.transformer_blocks.0.attn1.rotary_emb.freqs, up_blocks.1.temporal_attentions.0.transformer_blocks.0.attn1.rotary_emb.freqs, down_blocks.2.temporal_attentions.1.transformer_blocks.0.attn1.rotary_emb.freqs, down_blocks.2.temporal_attentions.0.transformer_blocks.0.attn1.rotary_emb.freqs, down_blocks.1.temporal_attentions.1.transformer_blocks.0.attn1.rotary_emb.freqs, down_blocks.1.temporal_attentions.0.transformer_blocks.0.attn1.rotary_emb.freqs, down_blocks.0.temporal_attentions.1.transformer_blocks.0.attn1.rotary_emb.freqs, down_blocks.0.temporal_attentions.0.transformer_blocks.0.attn1.rotary_emb.freqs Parameter indices which did not receive grad for rank 1: 4 24 44 64 84 104 124 144 164 184 204 224 244 264 284 304

It indicates some parameters are not used, have you ever met such a problem?

XianfanGu commented 2 months ago

Sorry we haven't met this issue. Probably the image resolution and video length are different from the default setting, and I still suggest following the default training setting. Please let me know and show more details of the error if you still have the same error after following the same training process with the default setting.