Adversarial machine learning

Ling Huang, Anthony D. Joseph, Blaine Nelson, Benjamin I.P. Rubinstein, J. D. Tygar
2011 Proceedings of the 4th ACM workshop on Security and artificial intelligence - AISec '11  
In this paper (expanded from an invited talk at AISEC 2010), we discuss an emerging field of study: adversarial machine learning-the study of effective machine learning techniques against an adversarial opponent. In this paper, we: give a taxonomy for classifying attacks against online machine learning algorithms; discuss application-specific factors that limit an adversary's capabilities; introduce two models for modeling an adversary's capabilities; explore the limits of an adversary's
more » ... ge about the algorithm, feature space, training, and input data; explore vulnerabilities in machine learning algorithms; discuss countermeasures against attacks; introduce the evasion challenge; and discuss privacy-preserving learning techniques.
doi:10.1145/2046684.2046692 dblp:conf/ccs/HuangJNRT11 fatcat:d6wcto4tmvbbrec35cjdengxby