Filters








157 Hits in 5.4 sec

Software Verification with Validation of Results [chapter]

Dirk Beyer
2017 Lecture Notes in Computer Science  
This report describes the 2017 Competition on Software Verification (SV-COMP), the 6 th edition of the annual thorough comparative evaluation of fully-automatic software verifiers.  ...  The major achievement of the 6 th edition of SV-COMP is that the verification results were validated in most categories.  ...  The scoring schema of SV-COMP 2017 is similar to the previous scoring schema, except that results with answer True are now assigned two points only if the witness was confirmed by a validator, and one  ... 
doi:10.1007/978-3-662-54580-5_20 fatcat:6vthnumx5bbavkkpzg3dm2qita

Advances in Automatic Software Verification: SV-COMP 2020 [chapter]

Dirk Beyer
2020 Lecture Notes in Computer Science  
This report describes the 2020 Competition on Software Verification (SV-COMP), the 9 th edition of a series of comparative evaluations of fully automatic software verifiers for C and Java programs.  ...  The competition provides a snapshot of the current state of the art in the area, and has a strong focus on replicability of its results.  ...  Introduction The Competition on Software Verification (SV-COMP) serves as the showcase of the state of the art in the area of automatic software verification.  ... 
doi:10.1007/978-3-030-45237-7_21 fatcat:puu4r3at5zgibduclvflgev7cq

Automatic Verification of C and Java Programs: SV-COMP 2019 [chapter]

Dirk Beyer
2019 Msphere  
This report describes the 2019 Competition on Software Verification (SV-COMP), the 8 th edition of a series of comparative evaluations of fully automatic software verifiers for C programs, and now also  ...  The competition provides a snapshot of the current state of the art in the area, and has a strong focus on replicability of its results.  ...  Introduction Software verification is an increasingly important research area, and the annual Competition on Software Verification (SV-COMP) 1 is the showcase of the state of the art in the area, in  ... 
doi:10.1007/978-3-030-17502-3_9 fatcat:nhfizu64uzhg7e4skftvgjrbyu

VeriAbs: Verification by Abstraction and Test Generation [chapter]

Priyanka Darke, Sumanth Prabhu, Bharti Chimdyalwar, Avriti Chauhan, Shrawan Kumar, Animesh Basakchowdhury, R. Venkatesh, Advaita Datar, Raveendra Kumar Medicherla
2018 Lecture Notes in Computer Science  
To prove properties with better efficiency and scalability, this version implements output abstraction with k -induction in the presence of resets.  ...  VeriAbs is a portfolio software verifier for ANSI-C programs.  ...  The SV-COMP 2017 version of VeriAbs cannot precisely validate programs with loops in which all variables are modified with non-linear P. Darke-Jury member. The Author(s) 2018 D. Beyer and M.  ... 
doi:10.1007/978-3-319-89963-3_32 fatcat:gllrmo5fwvcfzh37yksvawiffa

Second Competition on Software Testing: Test-Comp 2020 [chapter]

Dirk Beyer
2020 Lecture Notes in Computer Science  
This report describes the 2020 Competition on Software Testing (Test-Comp), the 2 nd edition of a series of comparative evaluations of fully automatic software test-case generators for C programs.  ...  The competition provides a snapshot of the current state of the art in the area, and has a strong focus on replicability of its results. The competition was based on 3 230 test tasks for C programs.  ...  For example, there are three competitions in the area of software verification: (i) a competition on automatic verifiers under controlled resources (SV-COMP [3]), (ii) a competition on verifiers with  ... 
doi:10.1007/978-3-030-45234-6_25 fatcat:hhxrutefwvfrbop2sxwxkf5huy

Predicting rankings of software verification tools

Mike Czech, Eyke Hüllermeier, Marie-Christine Jakobs, Heike Wehrheim
2017 Proceedings of the 3rd ACM SIGSOFT International Workshop on Software Analytics - SWAN 2017  
Using data sets from the software verification competition SV-COMP, we demonstrate our rank prediction technique to generalize well and achieve a rather high predictive accuracy (rank correlation > 0.6  ...  A software developer is hence faced with the problem of choosing a tool appropriate for her program at hand. A ranking of tools on programs could facilitate the choice.  ...  We have implemented our technique and carried out experimental (cross-validation) studies using data from SV-COMP 2015 and 2017.  ... 
doi:10.1145/3121257.3121262 dblp:conf/sigsoft/CzechHJW17 fatcat:sxx7gdxg75g2pnou4qqa6si75m

TOOLympics 2019: An Overview of Competitions in Formal Methods [chapter]

Ezio Bartocci, Dirk Beyer, Paul E. Black, Grigory Fedyukovich, Hubert Garavel, Arnd Hartmanns, Marieke Huisman, Fabrice Kordon, Julian Nagele, Mihaela Sighireanu, Bernhard Steffen, Martin Suda (+3 others)
2019 Msphere  
For the various research communities working on the verification of systems (software, hardware, or the underlying involved mechanisms), it is important to bring together the community and to compare the  ...  Scientific results have to be reproducible, and powerful computers are becoming cheaper and cheaper, thus, these competitions are becoming an important means for advancing research in verification technology  ...  SV-COMP: Competition on Software Verification Organizer: Dirk Beyer (LMU Munich, Germany) Webpage: https://sv-comp.sosy-lab.org/ The 2019 International Competition on Software Verification (SV-COMP) is  ... 
doi:10.1007/978-3-030-17502-3_1 fatcat:ry2mnbgxijbw7c2flufmx25wpq

Interpretation-Based Violation Witness Validation for C: NITWIT [chapter]

Jan Švejda, Philipp Berger, Joost-Pieter Katoen
2020 Lecture Notes in Computer Science  
It verifies a record number of witnesses of SV-COMP'20 in the ReachSafety category.  ...  As software verification is gaining traction in academia and industry the number and complexity of verification tools is growing constantly.  ...  We thank Dirk Beyer for very useful feedback on an earlier version of the paper and assistance with configuring nitwit for SV-COMP 2020.  ... 
doi:10.1007/978-3-030-45190-5_3 fatcat:7isjjgfvnvctvhmvb72zwjrgdy

Predicting Rankings of Software Verification Competitions [article]

Mike Czech, Eyke Hüllermeier, Marie-Christine Jakobs, Heike Wehrheim
2017 arXiv   pre-print
Software verification competitions, such as the annual SV-COMP, evaluate software verification tools with respect to their effectivity and efficiency.  ...  In this paper, we present a machine learning approach to predicting rankings of tools on verification tasks.  ...  In Table 2 (SV-COMP 2015) and Table 3 (SV-COMP 2017), we report the average prediction accuracies (and standard deviations) in terms of the Spearman rank correlation; note that an average accuracy  ... 
arXiv:1703.00757v1 fatcat:rk4hob6lhjdmtfzdjf4ce4bdxe

Algorithm selection for software validation based on graph kernels

Cedric Richter, Eyke Hüllermeier, Marie-Christine Jakobs, Heike Wehrheim
2020 Automated Software Engineering : An International Journal  
The evaluation, which is based on data sets from the annual software verification competition SV-COMP, demonstrates our kernel to generalize well and to achieve rather high prediction accuracy, both for  ...  In this paper, we study algorithm selection for software validation, i.e., the task of choosing a software validation tool for a given validation instance.  ...  To view a copy of this licence, visit http://creat iveco mmons .org/licen ses/by/4.0/.  ... 
doi:10.1007/s10515-020-00270-x fatcat:4b62vpw6izg3xce26ysdhovtp4

International Competition on Runtime Verification (CRV) [chapter]

Ezio Bartocci, Yliès Falcone, Giles Reger
2019 Msphere  
We review the first five years of the international Competition on Runtime Verification (CRV), which began in 2014.  ...  Runtime verification focuses on verifying system executions directly and is a useful lightweight technique to complement static verification techniques.  ...  In particular, in the area of software verification, there are three related competitions: SV-COMP [9] , VerifyThis [23] and the RERS Challenge [22] .  ... 
doi:10.1007/978-3-030-17502-3_3 fatcat:akcoht4qurbsjgl32hdt4ukfve

Using Academia-Industry Partnerships to Enhance Software Verification & Validation Education via Active Learning Tools

Sushil Acharya, Priyadarshan Manohar, Peter Wu, Walter Schilling
2017 Journal of Education and Learning  
Imparting real world experiences in a software verification and validation (SV&V) course is often a challenge due to the lack of effective active learning tools.  ...  on SV&V topics viz. requirements engineering, software reviews, configuration management, and software testing.  ...  Acknowledgements The authors acknowledge the support of NSF through a grant entitled "Collaborative Education: Building a Skilled V&V Community", NSF-TUES Award # 1245036.  ... 
doi:10.5539/jel.v6n2p69 fatcat:m4whzwledvenxevxtirvurld4m

Systematic Predicate Abstraction Using Variable Roles [chapter]

Yulia Demyanova, Philipp Rümmer, Florian Zuleger
2017 Lecture Notes in Computer Science  
For evaluation, we defined a set of heuristics, motivated by Eldarica's previous built-in heuristics and typical verification benchmarks from the literature and SV-COMP.  ...  Heuristics for discovering predicates for abstraction are an essential part of software model checkers.  ...  Benchmarks from the Loops category of SV-COMP'16 (we excluded 50 benchmarks for same reasons); 3. Benchmarks of the verification tool VeriMAP 6 .  ... 
doi:10.1007/978-3-319-57288-8_18 fatcat:ohkagt3dkzgefci3ocjz26egv4

More effective interpolations in software model checking

Cong Tian, Zhao Duan, Zhenhua Duan, C.-H. Luke Ong
2017 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE)  
Experiments on a large number of benchmark programs show that both the interpolations and the auxiliary optimization strategies are effective in improving scalability of software model checking.  ...  We show how these interpolants are computed and applied in safety verification. We have implemented our approach in a tool named INTERPCHECKER by building on an open source software model checker.  ...  Note that the result of CPAChecker presented in Table I might be inconsistent with the one reported in the competitions because of different experimental environment.  ... 
doi:10.1109/ase.2017.8115631 dblp:conf/kbse/TianDDO17 fatcat:b3qycvvifvfq5ojkobo3rlm2cy

The RERS challenge: towards controllable and scalable benchmark synthesis

Falk Howar, Marc Jasper, Malte Mues, David Schmidt, Bernhard Steffen
2021 International Journal on Software Tools for Technology Transfer (STTT)  
AbstractThis paper (1) summarizes the history of the RERS challenge for the analysis and verification of reactive systems, its profile and intentions, its relation to other competitions, and, in particular  ...  , its evolution due to the feedback of participants, and (2) presents the most recent development concerning the synthesis of hard benchmark problems.  ...  The software verification competition [8] (SV-COMP) is also concerned with reachability properties and features a few verification tasks concerning termination and memory safety.  ... 
doi:10.1007/s10009-021-00617-z fatcat:i7rvdpbxnjeyxp2ucd377oml7q
« Previous Showing results 1 — 15 out of 157 results