464 Hits in 1.7 sec

Metamorphic Testing of Constraint Solvers [chapter]

Özgür Akgün, Ian P. Gent, Christopher Jefferson, Ian Miguel, Peter Nightingale
2018 Lecture Notes in Computer Science  
In this paper we show that metamorphic testing is a principled way to test constraint solvers by comparing two different implementations of the same constraint.  ...  Specifically, specialised propagators for the constraint are tested against the general purpose table constraint propagator. We report on metamorphic testing of the constraint solver Minion.  ...  The Constraint Solver Minion Throughout this paper, we use the Minion constraint solver to illustrate metamorphic testing in constraint solvers.  ... 
doi:10.1007/978-3-319-98334-9_46 fatcat:3isau54rvzewdhyvtyhvaarxre

Automated metamorphic testing of variability analysis tools

Sergio Segura, Amador Durán, Ana B. Sánchez, Daniel Le Berre, Emmanuel Lonca, Antonio Ruiz-Cortés
2015 Software testing, verification & reliability  
These test data are generated from scratch using step-wise transformations and assuring that certain constraints (a.k.a. metamorphic relations) hold at each step.  ...  Among other results, we detected 19 real bugs in 7 out of the 15 tools under test.  ...  ACKNOWLEDGMENTS We appreciate the help of Dr Martin Monperrus whose comments and suggestions helped us to improve the article substantially. We would also like to thank Dr. Marcílio Mendonça, Dr.  ... 
doi:10.1002/stvr.1566 fatcat:yithe6brjbdahpl7nh7nwvm7mm


2011 International journal of software engineering and knowledge engineering  
We show that metamorphic testing can be effectively applied to the QAP in the absence of an oracle, and discuss the implications for the testing of solvers for other hard optimization problems.  ...  A number of metamorphic relations for the QAP are described in detail, and their effectiveness in "killing" mutated versions of an exact QAP solver is compared.  ...  Acknowledgements This project was supported by the Natural Science Foundation of China (Grant No.60421001) and Australian Research Council (ARC LX0776490).  ... 
doi:10.1142/s021819401100527x fatcat:omhhl4pckbbodmbpc25ma2fgsq

Symbolic execution based test-patterns generation algorithm for hardware Trojan detection

Lixiang Shen, Dejun Mu, Guo Cao, Maoyuan Qin, Jeremy Blackstone, Ryan Kastner
2018 Computers & security  
First, control flow graphs of Verilog code were generated. Next, parallel symbolic execution and satisfiability modulo theories solver generated test patterns.  ...  However, the combination of symbolic execution and metamorphic testing is useful for detecting hardware Trojans in Verilog code.  ...  SMT-LIBv2 is supported by many popular SMT solvers, making it very flexible to choose an SMT solver to implement our method. (4) Metamorphic testing was used to detect hardware Trojans.  ... 
doi:10.1016/j.cose.2018.07.006 fatcat:byf4mlthbze6fjaye2w3hemskq

Automated Test Data Generation on the Analyses of Feature Models: A Metamorphic Testing Approach

Sergio Segura, Robert M. Hierons, David Benavides, Antonio Ruiz-Cortés
2010 2010 Third International Conference on Software Testing, Verification and Validation  
In this paper, we present a set of relations (so-called metamorphic relations) between input FMs and their set of products and a test data generator relying on them.  ...  Current testing methods in this context mainly rely on the ability of the tester to decide whether the output of an analysis is correct.  ...  diagrams by means of JavaBDD 10 solver) and JaCoPReasoner v0.8.3 (using constraint programming by means of JaCoP 11 solver).  ... 
doi:10.1109/icst.2010.20 dblp:conf/icst/SeguraHBR10 fatcat:ddq2mkxv6rhc5hljz3b5vlit6q

Automated metamorphic testing on the analyses of feature models

Sergio Segura, Robert M. Hierons, David Benavides, Antonio Ruiz-Cortés
2011 Information and Software Technology  
analyses and 67 metamorphic testing.  ...  A detailed description of our metamorphic relations and test data generator is 68 presented in Section 3.  ...  Marcilio Mendonca for kindly sending us a standalone version of SPLOT 652 to be used in our evaluation and allowing us to publish the results in benefit of the research community.  ... 
doi:10.1016/j.infsof.2010.11.002 fatcat:t22tondvzvbpblqaqtummjnthq

Concolic Metamorphic Debugging

Hao Jin, Yanyan Jiang, Na Liu, Chang Xu, Xiaoxing Ma, Jian Lu
2015 2015 IEEE 39th Annual Computer Software and Applications Conference  
Debugging programs with weak or no oracle is even more difficult due to lack of passing and failing test runs as well as their comparisons.  ...  To address these challenges, we exploit metamorphic relations to construct new programs that are enhanced with synthesized oracle, and combine concolic testing and branchswitching debugging to localize  ...  As each branch condition is collected, we can switch any branch to obtain a new test input by invoking a constraint solver.  ... 
doi:10.1109/compsac.2015.79 dblp:conf/compsac/Jin0LXML15 fatcat:fjmqfi4u6zgcbevi626vj25ucu


Jiang Ming, Dongpeng Xu, Li Wang, Dinghao Wu
2015 Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security - CCS '15  
We then solve these formulas with a constraint solver. The result accurately answers whether the predicate under examination is opaque or not.  ...  We have developed a prototype of LOOP and evaluated it with a range of common utilities and obfuscated malicious programs. Our experimental results demonstrate the efficacy and generality of LOOP.  ...  This research was supported in part by the National Science Foundation (NSF) grants CNS-1223710 and CCF-1320605, and the Office of Naval Research (ONR) grant N00014-13-1-0175.  ... 
doi:10.1145/2810103.2813617 dblp:conf/ccs/MingXWW15 fatcat:ect2muhnsvejthbgktnpbeiqn4

Using Metamorphic Testing to Improve Dynamic Symbolic Execution

Eman Alatawi, Tim Miller, Harald Sondergaard
2015 2015 24th Australasian Software Engineering Conference  
Metamorphic testing uses domain-specific properties about program behaviour, relating pairs of inputs to pairs of outputs.  ...  they give rise to hard constraints, so that some parts of a program remain uncovered.  ...  ACKNOWLEDGMENTS The first author acknowledges support from Taibah University through a scholarship to pursue graduate studies at the University of Melbourne.  ... 
doi:10.1109/aswec.2015.16 dblp:conf/aswec/AlatawiMS15 fatcat:ayb7mwmvt5acjbguxakucbsis4

Generating Tests for Detecting Faults in Feature Models

Paolo Arcaini, Angelo Gargantini, Paolo Vavassori
2015 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST)  
Starting from this definition, we devise a technique, based on the use of a logic solver, able either to find distinguishing configurations to be used as tests or to prove that a mutation produces an equivalent  ...  Compact test suites can be produced by exploiting an SMT solver. The experiments show that our methodology is viable and produces reasonable sized test suites in a short time.  ...  [20] proposed using metamorphic testing to generate test data for feature model analysis tools.  ... 
doi:10.1109/icst.2015.7102591 dblp:conf/icst/ArcainiGV15 fatcat:4ixwj63aebfftlxhtcgu5ps5vu

Semi-Proving: An Integrated Method for Program Proving, Testing, and Debugging

T.Y. Chen, T.H. Tse, Zhi Quan Zhou
2011 IEEE Transactions on Software Engineering  
We present an integrated method for program proving, testing, and debugging. Using the concept of metamorphic relations, we select necessary properties for target programs.  ...  The method supports automatic debugging through the identification of constraint expressions that reveal failures. Index Terms-Software/program verification, symbolic execution, testing and debugging.  ...  Zhi Quan Zhou at the address shown on the first page of this paper. The authors are grateful to Willem Visser for his helps and discussions on symbolic-execution techniques using the  ... 
doi:10.1109/tse.2010.23 fatcat:x5od5enva5cszeih33fcwge2ru

JFuzz: A Tool for Automated Java Unit Testing Based on Data Mutation and Metamorphic Testing Methods

Hong Zhu
2015 2015 Second International Conference on Trustworthy Systems and Their Applications  
In this paper we propose a new kind of test automation framework by integrating data mutation testing and metamorphic testing methods. A tool for unit testing of Java class called JFuzz is presented.  ...  Automated test framework plays a significant role in test driven software development methodologies. The XUnit family of testing tools has been widely used in the industry.  ...  Chen at the Swinburne University of Technology, Australia, for his valuable comments on an earlier draft version of the paper.  ... 
doi:10.1109/tsa.2015.13 dblp:conf/tsa/Zhu15 fatcat:sxxdvf3a5zenhjglhu7mho5wwe


Fabricia Roos-Frantz, José A. Galindo, David Benavides, Antonio Ruiz-Cortés
2012 Proceedings of the 16th International Software Product Line Conference on - SPLC '12 -volume 1  
The automated analysis of OVMs is defined as the computer-aided extraction of information from such models.  ...  It has been developed as part of the FaMa ecosystem enabling the benefits coming from other tools of that ecosystem as FaMaFW and BeTTy.  ...  For instance, we developed a metamorphic generator extending the BeTTy tool [9] which allows us to perform functional testing over our new tool.  ... 
doi:10.1145/2364412.2364456 dblp:conf/splc/Roos-FrantzGBC12 fatcat:5xn4t2wpyzdodmffwjbwoh2tkm

∂-Explainer: Abductive Natural Language Inference via Differentiable Convex Optimization [article]

Mokanarangan Thayaparan, Marco Valentino, Deborah Ferreira, Julia Rozanova, André Freitas
2021 arXiv   pre-print
While constrained based solvers provide explanations, they are often limited by the use of explicit constraints and cannot be integrated as part of broader deep neural architectures.  ...  To demonstrate the efficacy of the framework, we transform the constraints presented by TupleILP and integrate them with sentence embedding transformers for the task of explainable science QA.  ...  testing for different values of k.  ... 
arXiv:2105.03417v1 fatcat:dxj3htriafarta36kddfj3dzva

Detecting Critical Bugs in SMT Solvers Using Blackbox Mutational Fuzzing [article]

Muhammad Numair Mansur, Maria Christakis, Valentin Wüstholz, Fuyuan Zhang
2020 arXiv   pre-print
We run our fuzzer on seven mature solvers and find 29 previously unknown critical bugs. STORM is already being used in testing new features of popular solvers before deployment.  ...  Given the wide applicability of solvers in software reliability, relying on such unsound results may have detrimental consequences.  ...  The latter constraint emerges because our implementation relies on Z3 for generating the mutated SMT instances (see Sect. 4). Tab. 2 shows the tested logics for each solver.  ... 
arXiv:2004.05934v1 fatcat:a3b2giyepzh4rlcu6brewvak3y
« Previous Showing results 1 — 15 out of 464 results