DUSC: Dimensionality Unbiased Subspace Clustering

Ira Assent, Ralph Krieger, Emmanuel Müller, Thomas Seidl
2007 Seventh IEEE International Conference on Data Mining (ICDM 2007)  
To gain insight into today's large data resources, data mining provides automatic aggregation techniques. Clustering aims at grouping data such that objects within groups are similar while objects in different groups are dissimilar. In scenarios with many attributes or with noise, clusters are often hidden in subspaces of the data and do not show up in the full dimensional space. For these applications, subspace clustering methods aim at detecting clusters in any subspace. Existing subspace
more » ... tering approaches fall prey to an effect we call dimensionality bias. As dimensionality of subspaces varies, approaches which do not take this effect into account fail to separate clusters from noise. We give a formal definition of dimensionality bias and analyze consequences for subspace clustering. A dimensionality unbiased subspace clustering (DUSC) definition based on statistical foundations is proposed. In thorough experiments on synthetic and real world data, we show that our approach outperforms existing subspace clustering algorithms. • definition and analysis of dimensionality bias and its consequences for subspace clustering • definition of density based on statistical foundations • dimensionality unbiased subspace clustering model • powerful pruning properties
doi:10.1109/icdm.2007.49 dblp:conf/icdm/AssentKMS07 fatcat:xpcpscejrjbpzazkrgannqyl6q