Filters








7 Hits in 1.5 sec

Datamorphic Testing: A Method for Testing Intelligent Applications

Hong Zhu, Dongmei Liu, Ian Bayley, Rachel Harrison, Fabio Cuzzolin
2019 2019 IEEE International Conference On Artificial Intelligence Testing (AITest)  
This paper proposes a new method called datamorphic testing, which consists of three components: a set of seed test cases, a set of datamorphisms for transforming test cases, and a set of metamorphisms  ...  Index Terms-software testing, intelligent applications, machine learning, test case generation, test oracle, datamorphism, metamorphism. I.  ...  Further Work We are developing an automated testing tool to support datamorphic testing method for AI applications.  ... 
doi:10.1109/aitest.2019.00018 dblp:conf/aitest/ZhuLBHC19 fatcat:iha6qp7bdrcy7fgdcsnedbr63m

Exploratory Datamorphic Testing of Classification Applications

Hong Zhu, Ian Bayley
2020 Proceedings of the IEEE/ACM 1st International Conference on Automation of Software Test  
This paper proposes a set of testing strategies for testing machine learning applications in the framework of the datamorphism testing methodology.  ...  Testing has been widely recognised as difficult for AI applications.  ...  In [20, 21] , we proposed a method called datamorphic testing for testing AI applications and reported a case study with face recognition applications.  ... 
doi:10.1145/3387903.3389312 dblp:conf/icse/0002B20 fatcat:rbmtwwle6jcl5eqd66r3um2qv4

Datamorphic Testing: A Methodology for Testing AI Applications [article]

Hong Zhu, Dongmei Liu, Ian Bayley, Rachel Harrison, Fabio Cuzzolin
2019 arXiv   pre-print
Based on this analysis, we propose a new method called datamorphic testing and illustrate the method with an example of testing face recognition applications.  ...  With the rapid growth of the applications of machine learning (ML) and other artificial intelligence (AI) techniques, adequate testing has become a necessity to ensure their quality.  ...  Further work We are developing an automated testing tool to support datamorphic testing method for AI applications.  ... 
arXiv:1912.04900v1 fatcat:y7r6fxg3y5bibkc43pskubgqei

Morphy: A Datamorphic Software Test Automation Tool [article]

Hong Zhu, Ian Bayley, Dongmei Liu, Xiaoyu Zheng
2019 arXiv   pre-print
The paper also illustrates their uses for testing both traditional software and AI applications with three case studies.  ...  In addition to datamorphisms, metamorphisms and seed test case makers, Morphy also employs a set of other test morphisms including test case metrics and filters, test set metrics and filters, test result  ...  In Morphy, a test specification is a Java class that declares a set of attributes for test entities and a set of methods for test morphisms.  ... 
arXiv:1912.09881v1 fatcat:2zssuptfjnecfcdtpipcixncle

Discovering Boundary Values of Feature-based Machine Learning Classifiers through Exploratory Datamorphic Testing [article]

Hong Zhu, Ian Bayley
2022 arXiv   pre-print
This paper proposes a set of testing strategies for testing machine learning applications in the framework of the datamorphism testing methodology.  ...  Testing has been widely recognised as difficult for AI applications.  ...  Award of Oxford Brookes University. e authors are grateful to the members of the AI So ware Engineering research group at the School of Engineering, Computing and Mathematics, Oxford Brookes University, for  ... 
arXiv:2110.00330v2 fatcat:ck5twzdeszearkdqqql4fyg3de

A Case Study of Testing an Image Recognition

Chuanqi Tao, Chuanqi Tao
2021 Journal of Visual Language and Computing  
This paper presents a case study of a realistic image recognition application called Calorie Mama using manual testing and automation testing with a 3D decision table.  ...  Then, the fourth part shows a case study of testing Calorie Mama APP using these two methods and presents the comparative results of test efficiency and coverage.  ...  [3] proposed a new method called datamorphic testing, which consists of three components: a set of seed test cases, a set of datamorphisms for transforming test cases, and a set of metamorphisms for  ... 
doi:10.18293/jvlc2021-n2-194 fatcat:e7opbrma2ngbllbncfnbrdidii

Database architecture evolution

Stefan Manegold, Martin L. Kersten, Peter Boncz
2009 Proceedings of the VLDB Endowment  
The holy grail for database architecture research is to find a solution that is Scalable & Speedy, to run on anything from small ARM processors up to globally distributed compute clusters, Stable & Secure  ...  , to service a broad user community, Small & Simple, to be comprehensible to a small team of programmers, Self-managing, to let it run out-of-the-box without hassle.  ...  We wish to thank all (former) members of the CWI database group for their effort, inspiration and dedication to make MonetDB a success.  ... 
doi:10.14778/1687553.1687618 fatcat:az3viqkxx5hf7gmu5zoih67hgq