An Assessment of Qualitative Performance of Machine Learning Architectures: Modular Feedback Networks

Mo Chen, T. Gautama, D.P. Mandic
2008 IEEE Transactions on Neural Networks  
A framework for the assessment of qualitative performance of machine learning architectures is proposed. For generality, the analysis is provided for the modular nonlinear pipelined recurrent neural network (PRNN) architecture. This is supported by a sensitivity analysis, which is achieved based upon the prediction performance with respect to changes in the nature of the processed signal and by utilizing the recently introduced delay vector variance (DVV) method for phase space signal
more » ... zation. Comprehensive simulations combining the quantitative and qualitative analysis on both linear and nonlinear signals suggest that better quantitative prediction performance may need to be traded in order to preserve the nature of the processed signal, especially where the signal nature is of primary importance (biomedical applications). Index Terms-Delay vector variance, nonlinearity, pipelined recurrent neural networks (PRNNs), qualitative performance, sensitivity.
doi:10.1109/tnn.2007.902728 pmid:18269949 fatcat:2ennrs72vvbt3ap5dngnk2q5oy