Why only padding tokens are generated after a period of training, but no words?

XiangLi1999 / Diffusion-LM

Diffusion-LM

Apache License 2.0

1.02k stars 133 forks source link

Why only padding tokens are generated after a period of training, but no words? #48

Open greens007 opened 1 year ago

greens007 commented 1 year ago

Hi, Lisa I try to duplicate your work. But I got into some trouble. Why only padding tokens are generated after a period of training, but no words? Do you ever meet it before? Looking forward to your reply!