LARGE‐SCALE DATA VISUALIZATION WITH MISSING VALUES

Sergiy Popov
2006 Technological and Economic Development of Economy  
Visualization of large‐scale data inherently requires dimensionality reduction to 1D, 2D, or 3D space. Autoassociative neural networks with a bottleneck layer are commonly used as a nonlinear dimensionality reduction technique. However, many real‐world problems suffer from incomplete data sets, i.e. some values can be missing. Common methods dealing with missing data include the deletion of all cases with missing values from the data set or replacement with mean or "normal" values for specific
more » ... ariables. Such methods are appropriate when just a few values are missing. But in the case when a substantial portion of data is missing, these methods can significantly bias the results of modeling. To overcome this difficulty, we propose a modified learning procedure for the autoassociative neural network that directly takes the missing values into account. The outputs of the trained network may be used for substitution of the missing values in the original data set.
doi:10.3846/13928619.2006.9637721 fatcat:jqtpeg7g3vdtbmxq4l3h7rllf4