Unsupervised feature selection under perturbations: meeting the challenges of biological data

Roy Varshavsky, Assaf Gottlieb, David Horn, Michal Linial
2007 Computer applications in the biosciences : CABIOS  
Motivation: Feature selection methods aim to reduce the complexity of data and to uncover the most relevant biological variables. In reality, information in biological datasets is often incomplete as a result of untrustworthy samples and missing values. The reliability of selection methods may therefore be questioned. Method: Information loss is incorporated into a perturbation scheme, testing which features are stable under it. This method is applied to data analysis by unsupervised feature
more » ... pervised feature filtering (UFF). The latter has been shown to be a very successful method in analysis of gene-expression data. Results: We find that the UFF quality degrades smoothly with information loss. It remains successful even under substantial damage. Our method allows for selection of a best imputation method on a dataset treated by UFF. More importantly, scoring features according to their stability under information loss is shown to be correlated with biological importance in cancer studies. This scoring may lead to novel biological insights.
doi:10.1093/bioinformatics/btm528 pmid:17989091 fatcat:cjv6cwd7g5hixcs5tzohbjzon4