Nonlinear System Identification Using Neural Networks Trained with Natural Gradient Descent

Mohamed Ibnkahla
2003 EURASIP Journal on Advances in Signal Processing  
We use natural gradient (NG) learning neural networks (NNs) for modeling and identifying nonlinear systems with memory. The nonlinear system is comprised of a discrete-time linear filter H followed by a zero-memory nonlinearity g(·). The NN model is composed of a linear adaptive filter Q followed by a two-layer memoryless nonlinear NN. A Kalman filter-based technique and a search-and-converge method have been employed for the NG algorithm. It is shown that the NG descent learning significantly
more » ... utperforms the ordinary gradient descent and the Levenberg-Marquardt (LM) procedure in terms of convergence speed and mean squared error (MSE) performance.
doi:10.1155/s1110865703306079 fatcat:6hhfrh6unrefdllbj4zk3m4gly