Online kernel density estimation for interactive learning

作者:

Highlights:

摘要

In this paper we propose a Gaussian-kernel-based online kernel density estimation which can be used for applications of online probability density estimation and online learning. Our approach generates a Gaussian mixture model of the observed data and allows online adaptation from positive examples as well as from the negative examples. The adaptation from the negative examples is realized by a novel concept of unlearning in mixture models. Low complexity of the mixtures is maintained through a novel compression algorithm. In contrast to the existing approaches, our approach does not require fine-tuning parameters for a specific application, we do not assume specific forms of the target distributions and temporal constraints are not assumed on the observed data. The strength of the proposed approach is demonstrated with examples of online estimation of complex distributions, an example of unlearning, and with an interactive learning of basic visual concepts.

论文关键词:Online learning,Kernel density estimation,Mixture models,Unlearning,Compression,Hellinger distance,Unscented transform

论文评审过程:Received 26 September 2008, Revised 22 June 2009, Accepted 18 September 2009, Available online 29 September 2009.

论文官网地址:https://doi.org/10.1016/j.imavis.2009.09.010