Is Neural LDA the same as LDA

MIND-Lab / OCTIS

OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)

MIT License

730 stars 105 forks source link

Is Neural LDA the same as LDA #42

Closed provalis closed 2 years ago

provalis commented 2 years ago

When using NeuralLDA as the model in OCTIS, it simply sets the model_type of AVITM to LDA. Does it simply do a standard LDA or something else? What is the corresponding model in the Srivastava and Sutton 2017 paper?

silviatti commented 2 years ago

Hello, we integrated the implementation of Neural LDA (corresponding to LDA VAE in the paper of Srivastava and Sutton) and Product-of-experts LDA available here. In that implementation, the parameter model_type controls if the model is LDA VAE (and it is set only to "lda" in this case, otherwise if it is "prodLDA" then the model is prodLDA.

Hope it is clear :)

Silvia