Filters








7,610 Hits in 4.1 sec

An Empirical Study on the Scalability of Selective Mutation Testing

Jie Zhang, Muyao Zhu, Dan Hao, Lu Zhang
2014 2014 IEEE 25th International Symposium on Software Reliability Engineering  
Based on the empirical study, for programs smaller than 16 KLOC, selective mutation testing has surprisingly good scalability.  ...  To study the scalability of selective mutation testing, we systematically explore how the program size impacts selective mutation testing through four projects (including 12 versions all together).  ...  In this paper, we explored the scalability of selective mutation testing by performing an empirical study on 12 versions of 4 projects.  ... 
doi:10.1109/issre.2014.27 dblp:conf/issre/ZhangZHZ14 fatcat:wtgpdjfonfh7zkxi2nk7ix7ho4

Let's get ready to rumble redux

Kumara Sastry, David E. Goldberg
2007 Proceedings of the 9th annual conference on Genetic and evolutionary computation - GECCO '07  
This study assumes that the recombination and mutation operators have the knowledge of the building blocks (BBs) and effectively exchange or search among competing BBs.  ...  On the other hand, when noise dominates, crossover is more efficient than mutation yielding a speedup of o( ).  ...  The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of the  ... 
doi:10.1145/1276958.1277215 dblp:conf/gecco/SastryG07 fatcat:a3muwxv7b5enjfqf456qxwwkbi

An empirical framework for comparing effectiveness of testing and property-based formal analysis

Jeremy S. Bradbury, James R. Cordy, Juergen Dingel
2005 The 6th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering - PASTE '05  
In this paper we present an approach to the assessment of testing and formal analysis tools using metrics to measure the quantity and efficiency of each technique at finding bugs.  ...  We are currently beginning to conduct experiments and this paper presents a discussion of possible outcomes of our proposed empirical study.  ...  Some of the expected contributions of our study include an experimental assessment framework and empirical data.  ... 
doi:10.1145/1108792.1108795 dblp:conf/paste/BradburyCD05 fatcat:hu5devxj4jh4lnv3coxccuvcba

An empirical framework for comparing effectiveness of testing and property-based formal analysis

Jeremy S. Bradbury, James R. Cordy, Juergen Dingel
2006 Software engineering notes  
In this paper we present an approach to the assessment of testing and formal analysis tools using metrics to measure the quantity and efficiency of each technique at finding bugs.  ...  We are currently beginning to conduct experiments and this paper presents a discussion of possible outcomes of our proposed empirical study.  ...  Some of the expected contributions of our study include an experimental assessment framework and empirical data.  ... 
doi:10.1145/1108768.1108795 fatcat:ljrwj35vtncxvleahtwcybv2ca

Empirical analysis of a genetic algorithm-based stress test technique

Vahid Garousi
2008 Proceedings of the 10th annual conference on Genetic and evolutionary computation - GECCO '08  
Detailed stages and objectives of the empirical analysis are reported. The findings of the study are furthermore used to better calibrate the parameters of the GA-based stress test technique.  ...  Therefore, there is a strong need to empirically investigate the capacity of evolutionary test techniques to achieve the desired objectives (e.g., generate stress test cases) and their scalability in terms  ...  As he mentioned, empirical studies of software testing should go beyond assessing the cost-effectiveness of test techniques.  ... 
doi:10.1145/1389095.1389433 dblp:conf/gecco/Garousi08 fatcat:qanbwdn3sncc7hrgdraz7vn6fu

Achieving scalable mutation-based generation of whole test suites

Gordon Fraser, Andrea Arcuri
2014 Empirical Software Engineering  
, and second we use whole test suite generation to optimize test suites towards killing the highest number of mutants, rather than selecting individual mutants.  ...  The experiment demonstrates that our approach scales well, making mutation testing a viable test criterion for automated test case generation tools, and allowing us to analyze the relationship of branch  ...  Acknowledgements This project has been funded by a Google Focused Research Award on "Test Amplification" and the Norwegian Research Council. References Acree AT (1980) On mutation.  ... 
doi:10.1007/s10664-013-9299-z fatcat:zjszitxffzfrtp24jy443a4hb4

A Systematic Mapping Study of Empirical Studies on Software Cloud Testing Methods

Amro Al-Said Ahmad, Pearl Brereton, Peter Andras
2017 2017 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C)  
Objective: The purpose of this systematic mapping study is to provide an overview of the empirical research in the area of software cloud-based testing, in order to build a classification scheme.  ...  testing in the context of cloud environments.  ...  They evaluate the proposed mutation functional testing using a case study on Google Chrome and Amazon EC2 with 820 implemented mutations.  ... 
doi:10.1109/qrs-c.2017.94 dblp:conf/qrs/AhmadBA17 fatcat:qemz4oinz5clhcculuigri3kp4

Mutation Analysis for Cyber-Physical Systems: Scalable Solutions and Results in the Space Domain [article]

Oscar Cornejo, Fabrizio Pastore, Lionel Briand
2021 arXiv   pre-print
Further, we report on the largest study involving embedded software systems in the mutation analysis literature.  ...  These industry partners provided the case studies reported in this paper; they include an on-board software system managing a microsatellite currently on-orbit, a set of libraries used in deployed cubesats  ...  Based on our analysis, empirical studies on the applicability of mutation testing and analysis to safety-critical, industrial systems are very limited.  ... 
arXiv:2101.05111v3 fatcat:2p4t2dj2ufdw5nbrov5wag24ga

Understanding Software: Recent Lessons from Empirical Software Engineering [article]

TIm Menzies
2017 Figshare  
Invited talk given by Tim Menzies (NC State) at the 2017 SI2 PI Meeting.  ...  • Evolutionary optimizers = select, crossover, mutate, repeat • Select: ○ Evaluate only 2 distant "poles" ○ Cull the half on the worst pole • Crossover, mutate ○ In the surviving leaves, ○ mutate  ...  Pierret, Poshyvanyk, An Empirical Exploration of Regularities in Open-Source Software Lexicons, ICPC'09 Hindle et al. On the naturalness of software, ICSE'12 Ray et al.  ... 
doi:10.6084/m9.figshare.4680961.v1 fatcat:jos74gqu35djnbdz72sdoygcxa

Mutation Analysis for Cyber-Physical Systems: Scalable Solutions and Results in the Space Domain

Oscar Eduardo Cornejo Olivares, Fabrizio Pastore, Lionel Briand
2021 IEEE Transactions on Software Engineering  
These industry partners provided the case studies reported in this paper; they include an on-board software system managing a microsatellite currently on-orbit, a set of libraries used in deployed cubesats  ...  Further, we report on the largest study involving embedded software systems in the mutation analysis literature.  ...  Based on our analysis, empirical studies on the applicability of mutation testing and analysis to safety-critical, industrial systems are very limited.  ... 
doi:10.1109/tse.2021.3107680 fatcat:kmpctu57njebtf3dk3wu7b33bi

A Genetic Algorithm-Based Stress Test Requirements Generator Tool and Its Empirical Evaluation

Vahid Garousi
2010 IEEE Transactions on Software Engineering  
Findings of the empirical evaluation reveal that the tool is robust and reasonably scalable when it is executed on large-scale experimental design models.  ...  It is hoped that the findings of this empirical study help other SBSE researchers with the empirical evaluation of their own techniques and tools.  ...  The author would like to sincerely thank all the anonymous reviewers of this article for their valuable comments, criticisms, and suggestions which greatly improved the quality of this article.  ... 
doi:10.1109/tse.2010.5 fatcat:ochgkxcc2rhsjhnyzb33rckisy

Trivial Compiler Equivalence: A Large Scale Empirical Study of a Simple, Fast and Effective Equivalent Mutant Detection Technique

Mike Papadakis, Yue Jia, Mark Harman, Yves Le Traon
2015 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering  
Identifying equivalent mutants remains the largest impediment to the widespread uptake of mutation testing. Despite being researched for more than three decades, the problem remains.  ...  We present a thorough empirical study using 6 large open source programs, several orders of magnitude larger than those used in previous work, and 18 benchmark programs with hand-analysis equivalent mutants  ...  We present a thorough empirical study of TCE's potential to address this long-standing mutation testing challenge.  ... 
doi:10.1109/icse.2015.103 dblp:conf/icse/PapadakisJHT15 fatcat:sv5pnnbtzzawlahn4zy7jv6q4m

EvAg: a scalable peer-to-peer evolutionary algorithm

J. L. J. Laredo, A. E. Eiben, M. van Steen, J. J. Merelo
2009 Genetic Programming and Evolvable Machines  
This paper studies the scalability of an Evolutionary Algorithm (EA) whose population is structured by means of a gossiping protocol and where the evolutionary operators act exclusively within the local  ...  In particular, we analyze the behavior of several EAs on wellknown deceptive trap functions with varying sizes and levels of deceptiveness.  ...  Acknowledgments This work has been supported by the Spanish MICYT project TIN2007-68083-C02-01, the Junta de Andalucia CICE project P06-TIC-02025 and the Granada University PIUGR 9/11/06 project.  ... 
doi:10.1007/s10710-009-9096-z fatcat:535crilm4jduxktzq6oxx6qiny

Evolutionary Computation for Large-scale Multi-objective Optimization: A Decade of Progresses

Wen-Jing Hong, Peng Yang, Ke Tang
2021 International Journal of Automation and Computing  
From the key difficulties of the large-scale MOPs, the scalability analysis is discussed by focusing on the performance of existing MOEAs and the challenges induced by the increase of the number of decision  ...  As a result, and motivated by the emergence of real-world large-scale MOPs, investigation of MOEAs in this aspect has attracted much more attention in the past decade.  ...  Acknowledgements This work was supported by the Natural Science  ... 
doi:10.1007/s11633-020-1253-0 fatcat:q636cuvarbco7kmnvthnfysa54

Web application testing: A systematic literature review

Serdar Doğan, Aysu Betin-Can, Vahid Garousi
2014 Journal of Systems and Software  
As part of this study, we pose three sets of research questions, define selection and exclusion criteria, and synthesize the empirical evidence in this area.  ...  Among our results are the followings: (1) the list of test tools in this area and their capabilities, (2) the types of test models and fault models proposed in this domain, (3) the way the empirical studies  ...  Vahid Garousi was additionally supported by the University of Calgary and the Natural Sciences and Engineering Research Council of Canada (NSERC).  ... 
doi:10.1016/j.jss.2014.01.010 fatcat:6pc2zs4cwng7nh4gfnd5zjjj4a
« Previous Showing results 1 — 15 out of 7,610 results