Hofmeyr, David and Pavlidis, Nicos and Eckley, Idris (2016) Divisive clustering of high dimensional data streams. Statistics and Computing, 26 (5). 1101–1120. ISSN 0960-3174
HSDC.pdf - Accepted Version
Available under License Creative Commons Attribution.
Download (658kB)
Abstract
Clustering streaming data is gaining importance as automatic data acquisition technologies are deployed in diverse applications. We propose a fully incremental projected divisive clustering method for high-dimensional data streams that is motivated by high density clustering. The method is capable of identifying clusters in arbitrary subspaces, estimating the number of clusters, and detecting changes in the data distribution which necessitate a revision of the model. The empirical evaluation of the proposed method on numerous real and simulated datasets shows that it is scalable in dimension and number of clusters, is robust to noisy and irrelevant features, and is capable of handling a variety of types of non-stationarity.