Back propagation method with momentum has often been applied to adapt artificial neural networks for various pattern classification problems. However, an important limitation of this method is that its learning performance depends heavily upon the selection of the values of momentum factor and step size. In this paper, it is shown that hierarchical structure stochastic automata are quite helpful for finding appropriate values of the parameters involved in the BP method with momentum.