adjidieng / ETM

Topic Modeling in Embedding Spaces
MIT License
538 stars 126 forks source link

Model #2

Closed wgzhendong closed 4 years ago

wgzhendong commented 5 years ago

Could you tell me the meaning of the parameters in this formula? kl_theta = -0.5 * torch.sum(1 + logsigma_theta - mu_theta.pow(2) - logsigma_theta.exp(), dim=-1).mean()

adjidieng commented 5 years ago

Those are the parameters of the variational distribution over the topic proportions \theta.