Have you try pretrain the generator by using the next-word-predict loss?

CR-Gjx / LeakGAN

The codes of paper "Long Text Generation via Adversarial Training with Leaked Information" on AAAI 2018. Text generation using GAN and Hierarchical Reinforcement Learning.

https://arxiv.org/abs/1709.08624

576 stars 180 forks source link

Have you try pretrain the generator by using the next-word-predict loss? #23

Open guotong1988 opened 5 years ago

guotong1988 commented 5 years ago

Thank you! @CR-Gjx