Open hucheng opened 9 years ago
We can split the perplexity into two parts, e.g. word perplexity and doc perplexity. Then we will look into the impact of the different initialization strategies to the two perplexity parts.
Great. Look forward to the experimental result of both word perplexity and doc perplexity.
The phenomenon of LDA training is that the first several training is very costly, this is largely due to the uniformly random initialization that the word-topic thus doc-topic is quite dense.
There are two approaches: