A lemmatization method for Mongolian and its application to indexing for information retrieval

作者:

Highlights:

摘要

In Mongolian, two different alphabets are used, Cyrillic and Mongolian. In this paper, we focus solely on the Mongolian language using the Cyrillic alphabet, in which a content word can be inflected when concatenated with one or more suffixes. Identifying the original form of content words is crucial for natural language processing and information retrieval. We propose a lemmatization method for Mongolian. The advantage of our lemmatization method is that it does not rely on noun dictionaries, enabling us to lemmatize out-of-dictionary words. We also apply our method to indexing for information retrieval. We use newspaper articles and technical abstracts in experiments that show the effectiveness of our method. Our research is the first significant exploration of the effectiveness of lemmatization for information retrieval in Mongolian.

论文关键词:Lemmatization,Mongolian language,Natural language processing,Information retrieval

论文评审过程:Received 19 May 2008, Revised 9 September 2008, Accepted 24 January 2009, Available online 5 March 2009.

论文官网地址:https://doi.org/10.1016/j.ipm.2009.01.008