The Speed of Shor's R-algorithm

J. V. Burke, A. S. Lewis, M. L. Overton
2008 IMA Journal of Numerical Analysis  
Dedicated to M. J. D. Powell, master of convergence analysis for nonlinear optimization, on the occasion of his 70th birthday. Shor's r-algorithm is an iterative method for unconstrained optimization, designed for minimizing nonsmooth functions, for which its reported success has been considerable. Although some limited convergence results are known, nothing seems to be known about the algorithm's rate of convergence, even in the smooth case. We study how the method behaves on convex
more » ... n convex quadratics, proving linear convergence in the two-dimensional case and conjecturing that the algorithm is always linearly convergent, with an asymptotic convergence rate that is independent of the conditioning of the quadratic being minimized.
doi:10.1093/imanum/drn008 fatcat:e32axyq6ozc2pe6wjqkgp5i4si