Datamorphic Testing: A Methodology for Testing AI Applications [article]

Hong Zhu, Dongmei Liu, Ian Bayley, Rachel Harrison, Fabio Cuzzolin
2019 arXiv   pre-print
With the rapid growth of the applications of machine learning (ML) and other artificial intelligence (AI) techniques, adequate testing has become a necessity to ensure their quality. This paper identifies the characteristics of AI applications that distinguish them from traditional software, and analyses the main difficulties in applying existing testing methods. Based on this analysis, we propose a new method called datamorphic testing and illustrate the method with an example of testing face
more » ... ecognition applications. We also report an experiment with four real industrial application systems of face recognition to validate the proposed approach.
arXiv:1912.04900v1 fatcat:y7r6fxg3y5bibkc43pskubgqei