Topic Discovery based on LDA_col Model and Topic Significance Re-ranking

Lidong Wang, Baogang Wei, Jie Yuan
2011 Journal of Computers  
This paper presents a method to find the topics efficiently by the combination of topic discovery and topic re-ranking. Most topic models rely on the bag-ofwords(BOW) assumption. Our approach allows an extension of LDA model-Latent Dirichlet Allocation_Collocation (LDA_col) to work in corpus such that the word order can be taken into consideration for phrase discovery, and slightly modify the modal for modal consistency and effectiveness. However, LDA_col results may not be ideal for user's
more » ... rstanding. In order to improve the topic modeling results, two topic significance re-ranking methods (Topic Coverage(TC) and Topic Similarity(TS)) are proposed. We conduct our method on both English and Chinese corpus, the experimental results show that the modified LDA_col discovers more meaningful phrases and more understandable topics than LDA and LDA_col. Meanwhile, topic re-ranking method based on TC performs better than TS, and has the ability of re-ranking the "significant" topics higher than "insignificant" ones.
doi:10.4304/jcp.6.8.1639-1647 fatcat:oonap7qmkrdofi2evclxtkke44