search

nouhadziri / THRED

The implementation of the paper "Augmenting Neural Response Generation with Context-Aware Topical Attention"
https://arxiv.org/abs/1811.01063
MIT License
111 stars 25 forks source link

topic model for short text #21

Closed Monica9502 closed 4 years ago

Monica9502 commented 4 years ago

Hi, I have tried to build LDA model by gensim using my customed data for short text like twitter, however, the topic words seem not very fine-grained like yours, which is a commom problem of LDA model for short text. Do you have any suggestions for this? Thanks!

ehsk commented 4 years ago

You can use TwitterLDA [1] for topic modeling in short documents. You may also find this article useful.

[1] Zhao, W.X., Jiang, J., Weng, J., He, J., Lim, E.P., Yan, H. and Li, X., "Comparing twitter and traditional media using topic models," In ECIR 2011.