search

vineetjohn / linguistic-style-transfer

Neural network parametrized objective to disentangle and transfer style and content in text
Apache License 2.0
139 stars 33 forks source link

Stabilize VAE training #54

Closed vineetjohn closed 6 years ago

vineetjohn commented 6 years ago

Posterior collapse, KL loss term is too low

vineetjohn commented 6 years ago

Trying out separate KL weights for style and content KL losses UPDATE: Posterior collapse still occurs

vineetjohn commented 6 years ago

Trying out KL annealing based on current epoch number UPDATE: Seems to help until a certain epoch