A novel measure for independent component analysis (ICA)

Dongxin Xu, J.C. Principe, J. Fisher, Hsiao-Chun Wu
Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181)  
Measures of independence (and dependence) are fundamental in many areas of engineering and signal processing. Shannon introduced the idea of Information Entropy which has a sound theoretical foundation but sometimes is not easy to implement in engineering applications. In this paper, Renyi's Entropy is used and a novel independence measure is proposed. When integrated with a nonparametric estimator of the probability density function (Parzen Window), the measure can be related to the "potential
more » ... d to the "potential energy of the samples" which is easy to understand and implement. The experimental results on Blind Source Separation confirm the theory. Although the work is preliminary, the "potential energy" method is rather general and will have many applications.
doi:10.1109/icassp.1998.675476 dblp:conf/icassp/XuPFW98 fatcat:mrn34ylabvgvlnvmf7o2aue5ci