Dependency structure language model for topic detection and tracking
作者:
Highlights:
•
摘要
In this paper, we propose a new language model, namely, a dependency structure language model, for topic detection and tracking (TDT) to compensate for weakness of unigram and bigram language models. The dependency structure language model is based on the Chow expansion theory and the dependency parse tree generated by a linguistic parser. So, long-distance dependencies can be naturally captured by the dependency structure language model. We carried out extensive experiments to verify the proposed model on topic tracking and link detection in TDT. In both cases, the dependency structure language models perform better than strong baseline approaches.
论文关键词:Dependency structure language model,Term dependence,Dependency parse tree,Topic detection and tracking
论文评审过程:Received 9 January 2006, Accepted 28 February 2006, Available online 25 January 2007.
论文官网地址:https://doi.org/10.1016/j.ipm.2006.02.007