Beyond Backpropagation

Randall S. Sexton, Robert E. Dorsey, John D. Johnson
1999 Journal of Organizational and End User Computing  
The vast majority of neural network research relies on a gradient algorithm, typically a variation of backpropagation, to obtain the weights of the model. Because of the enigmatic nature of complex nonlinear optimization problems, such as training artificial neural networks, this technique has often produced inconsistent and unpredictable results. To go beyond backpropagation's typical selection of local solutions, simulated annealing is suggested as an alternative training technique that will
more » ... earch globally. In this research, backpropagation will be directly compared with this global search technique via an intensive Monte Carlo study on seven test functions
doi:10.4018/joeuc.1999070101 fatcat:t2bluizlzbaafj4z6duh56vsqy