The security of machine learning

Marco Barreno, Blaine Nelson, Anthony D. Joseph, J. D. Tygar
2010 Machine Learning  
Machine learning has become a fundamental tool for computer security since it can rapidly evolve to changing and complex situations. That adaptability is also a vulnerability: attackers can exploit machine learning systems. We present a taxonomy identifying and analyzing attacks against machine learning systems. We show how these classes influence the costs for the attacker and defender, and we give a formal structure defining their interaction. We use our framework to survey and analyze the
more » ... erature of attacks against machine learning systems. We also illustrate our taxonomy by showing how it can guide attacks against SpamBayes, a popular statistical spam filter. Finally, we discuss how our taxonomy suggests new lines of defenses.
doi:10.1007/s10994-010-5188-5 fatcat:3ytty65oknh7lkl6tfovfmu5ra