Learning regional transliteration variants

作者:

Highlights:

摘要

This paper conducts an inquiry into regional transliteration variants across Chinese speaking regions. We begin by studying the social association of regional transliterations, followed by postulating a computational model for effective transliteration extraction from the Web. In the computational model, we first propose constraint-based exploration by incorporating transliteration knowledge from transliteration modeling and predictive query suggestions from search engines into query formulation as constraints so as to increase the chance of desired transliteration returns in learning regional transliteration variants. Then, we study a cross-training algorithm, which explores the attainably helpful information of transliteration mappings across related regional corpora for the learning of transliteration models, to improve the overall extraction performance. The experimental results show that the proposed method not only effectively harvests a lexicon of regional transliteration variants but also mitigates the need of manual data labeling for transliteration modeling. We also carry out an investigation into the underlying characteristics of regional transliterations that motivate the cross-training algorithm.

论文关键词:Transliteration variation,Transliteration variants,Cross-training algorithm,Constraint-based exploration,Predictive query suggestions,Regional social association

论文评审过程:Received 1 October 2009, Revised 7 October 2010, Accepted 14 February 2011, Available online 9 March 2011.

论文官网地址:https://doi.org/10.1016/j.ipm.2011.02.003