A State-of-the-art Survey of Advanced Optimization Methods in Machine Learning

Muhamet Kastrati, Marenglen Biba
2021 International Conference on Recent Trends and Applications in Computer Science and Information Technology  
The main objective of this paper is to provide a state-of-the-art survey of advanced optimization methods used in machine learning. It starts with a short introduction to machine learning followed by the formulation of optimization problems in three main approaches to machine learning. Then optimization is presented along with a review of the most recent state-of-the-art methods and algorithms that are being extensively used in machine learning in general and deep neural networks in particular.
more » ... The paper concludes with some general recommendations for future work in the area.
dblp:conf/rtacsit/KastratiB21 fatcat:gcvz6va2wrdgvcorfb52qdac4q