Robust outlier detection using the instability factor

作者:

Highlights:

摘要

Since outlier detection is applicable to various fields such as the financial, telecommunications, medical, and commercial industries, its importance is radically increasing. Receiving such great attention has led to the development of many detection methods, most of which pertain to either the distance-based approach or the density-based approach. However, each approach has intrinsic weaknesses. The former hardly detects local outliers, while the latter has the low density patterns problem. To overcome these weaknesses, we proposed a new detection method that introduces the instability factor of a data point by utilizing the concept of the center of gravity. The proposed method can be flexibly used for both local and global detection of outliers by controlling its parameter. In addition, it offers the instability plot containing useful information about the number and size of clusters in data. Numerical experiments based on artificial and real datasets show the effectiveness of the proposed method.

论文关键词:Outlier detection,Noise removal,Instability factor,Nearest neighbors,Data mining

论文评审过程:Received 15 August 2013, Revised 1 March 2014, Accepted 1 March 2014, Available online 24 March 2014.

论文官网地址:https://doi.org/10.1016/j.knosys.2014.03.001