Component-based discriminative classification for hidden Markov models

作者:

Highlights:

摘要

Hidden Markov models (HMMs) have been successfully applied to a wide range of sequence modeling problems. In the classification context, one of the simplest approaches is to train a single HMM per class. A test sequence is then assigned to the class whose HMM yields the maximum a posterior (MAP) probability. This generative scenario works well when the models are correctly estimated. However, the results can become poor when improper models are employed, due to the lack of prior knowledge, poor estimates, violated assumptions or insufficient training data.To improve the results in these cases we propose to combine the descriptive strengths of HMMs with discriminative classifiers. This is achieved by training feature-based classifiers in an HMM-induced vector space defined by specific components of individual hidden Markov models.We introduce four major ways of building such vector spaces and study which trained combiners are useful in which context. Moreover, we motivate and discuss the merit of our method in comparison to dynamic kernels, in particular, to the Fisher Kernel approach.

论文关键词:Hidden Markov models,Discriminative classification,Dimensionality reduction,Hybrid models,Generative embeddings

论文评审过程:Received 15 September 2008, Revised 10 March 2009, Accepted 18 March 2009, Available online 5 April 2009.

论文官网地址:https://doi.org/10.1016/j.patcog.2009.03.023