Filters








17 Hits in 1.5 sec

VerifyThis 2019: a program verification competition

Claire Dross, Carlo A Furia, Marieke Huisman, Rosemary Monahan, Peter Müller
2021 International Journal on Software Tools for Technology Transfer (STTT)  
AbstractVerifyThis is a series of program verification competitions that emphasize the human aspect: participants tackle the verification of detailed behavioral properties—something that lies beyond the  ...  This paper describes the 8th edition of VerifyThis, which took place at ETAPS 2019 in Prague.  ...  Siegel for submitting ideas for competition problems; and Virgile Prevosto for accepting, on a short notice, our invitation to give a tutorial.  ... 
doi:10.1007/s10009-021-00619-x fatcat:vmrd4albxjalvcdvfxquywlphi

VerifyThis 2019: A Program Verification Competition (Extended Report) [article]

Claire Dross, Carlo A. Furia, Marieke Huisman, Rosemary Monahan, Peter Müller
2021 arXiv   pre-print
VerifyThis is a series of program verification competitions that emphasize the human aspect: participants tackle the verification of detailed behavioral properties -- something that lies beyond the capabilities  ...  This paper describes the 8th edition of VerifyThis, which took place at ETAPS 2019 in Prague.  ...  Siegel for submitting ideas for competition problems; and Virgile Prevosto for accepting, on a short notice, our invitation to give a tutorial.  ... 
arXiv:2008.13610v3 fatcat:zf3hegfrq5hdfnt6xp4dkuphy4

VerifyThis – Verification Competition with a Human Factor [chapter]

Gidon Ernst, Marieke Huisman, Wojciech Mostowski, Mattias Ulbrich
2019 Msphere  
VerifyThis is a series of competitions that aims to evaluate the current state of deductive tools to prove functional correctness of programs.  ...  Regarding the impact of VerifyThis on deductive verification research, a survey conducted among the previous participants shows that the event is a key enabler for gaining insight into other approaches  ...  We thank Rosemary Monahan for suggestions to improve the competition format and feedback on the manuscript.  ... 
doi:10.1007/978-3-030-17502-3_12 fatcat:3jpplx4n3bcg3mkle5nrdfkmo4

TOOLympics II: competitions on formal methods

Dirk Beyer, Marieke Huisman, Fabrice Kordon, Bernhard Steffen
2021 International Journal on Software Tools for Technology Transfer (STTT)  
The first issue presented the competition on software testing Test-Comp 2019, which was part of the TOOLympics 2019 event.  ...  The new theme was established to support competitions and challenges with an appropriate publication venue.  ...  VerifyThis 2019: a program verification competition [4] VerifyThis is a program-verification competition in which participants prove expressive input/output properties of small programs with complex behavior  ... 
doi:10.1007/s10009-021-00631-1 fatcat:3ifcufuotbg23oo72apwuvhgym

TOOLympics 2019: An Overview of Competitions in Formal Methods [chapter]

Ezio Bartocci, Dirk Beyer, Paul E. Black, Grigory Fedyukovich, Hubert Garavel, Arnd Hartmanns, Marieke Huisman, Fabrice Kordon, Julian Nagele, Mihaela Sighireanu, Bernhard Steffen, Martin Suda (+3 others)
2019 Msphere  
Competitions are a suitable way to do that. The first verification competition was created in 1992 (SAT competition), shortly followed by the CASC competition in 1996.  ...  TOOLympics 2019 is an event to celebrate the achievements of the various competitions, and to understand their commonalities and differences.  ...  The aims of the VerifyThis competition are: VerifyThis • to bring together those interested in formal verification, • to provide an engaging, hands-on, and fun opportunity for discussion, and • to evaluate  ... 
doi:10.1007/978-3-030-17502-3_1 fatcat:ry2mnbgxijbw7c2flufmx25wpq

Automatic Verification of C and Java Programs: SV-COMP 2019 [chapter]

Dirk Beyer
2019 Msphere  
This report describes the 2019 Competition on Software Verification (SV-COMP), the 8 th edition of a series of comparative evaluations of fully automatic software verifiers for C programs, and now also  ...  Each verification task consisted of a program and a property (reachability, memory safety, overflows, termination). SV-COMP 2019 had 31 participating verification systems from 14 countries.  ...  Including Java Programs The first seven editions of SV-COMP considered only programs written in C. In 2019, the competition was extended to include a Java track.  ... 
doi:10.1007/978-3-030-17502-3_9 fatcat:nhfizu64uzhg7e4skftvgjrbyu

International Competition on Runtime Verification (CRV) [chapter]

Ezio Bartocci, Yliès Falcone, Giles Reger
2019 Msphere  
The competition has gone through a number of changes since its introduction, which we highlight in this paper.  ...  Runtime verification focuses on verifying system executions directly and is a useful lightweight technique to complement static verification techniques.  ...  In particular, in the area of software verification, there are three related competitions: SV-COMP [9] , VerifyThis [23] and the RERS Challenge [22] .  ... 
doi:10.1007/978-3-030-17502-3_3 fatcat:akcoht4qurbsjgl32hdt4ukfve

VerifyThis Long-term Challenge 2020: Proceedings of the Online-Event

Marieke [Hrsg.] Huismann, Raùl E. [Hrsg.] Monti, Mattias [Hrsg.] Ulbrich, Alexander [Hrsg.] Weigl
2020
A final workshop session for the challenge had been planned at ETAPS (along with the VerifyThis program verification competition). Since ETAPS has been postponed, we met and exchanged online.  ...  During the online meeting, the different solutions were briefly explained, and we discussed the approaches, how they can benefit from one another and how further verification success can be stipulated.  ...  Preface The VerifyThis verification competition is a regular event run as an on-site meeting with workshop character in which three challenges are proposed that participants have to verify in 90 minutes  ... 
doi:10.5445/ir/1000119426 fatcat:2uyds54vnfhczidjhvnsywsjte

Advances in Automatic Software Verification: SV-COMP 2020 [chapter]

Dirk Beyer
2020 Lecture Notes in Computer Science  
The competition was based on 11 052 verification tasks for C programs and 416 verification tasks for Java programs.  ...  This report describes the 2020 Competition on Software Verification (SV-COMP), the 9 th edition of a series of comparative evaluations of fully automatic software verifiers for C and Java programs.  ...  Most closely related are the competitions RERS 4 [45] and VerifyThis 5 [46] .  ... 
doi:10.1007/978-3-030-45237-7_21 fatcat:puu4r3at5zgibduclvflgev7cq

A benchmark for C program verification [article]

Marko van Eekelen, Daniil Frumin, Herman Geuvers, Léon Gondelman, Robbert Krebbers, Marc Schoolderman, Sjaak Smetsers, Freek Verbeek, Benoît Viguier, Freek Wiedijk
2019 arXiv   pre-print
We present twenty-five C programs, as a benchmark for C program verification using formal methods.  ...  This benchmark can be used for system demonstration, for comparison of verification effort between systems, and as a friendly competition.  ...  p=vacid • Verfified Software Competition [9, 16] . • VerifyThis Competition: http://www.pm.inf.ethz.ch/research/verifythis.html The main difference from the benchmark presented here is that they do not  ... 
arXiv:1904.01009v1 fatcat:7avnl3bp2raw7jzjrewmc2fq2a

Deductive Software Verification: From Pen-and-Paper Proofs to Industrial Tools [chapter]

Reiner Hähnle, Marieke Huisman
2019 Lecture Notes in Computer Science  
Deductive software verification aims at formally verifying that all possible behaviors of a given program satisfy formally defined, possibly complex properties, where the verification process is based  ...  We take stock of the state-of-art and give a list of the most important challenges for the further development of the field of deductive software verification.  ...  Further, the VS-Comp and VerifyThis 3 program verification competitions have been established, where the developers and users of various deductive verification tools are challenged to solve program verification  ... 
doi:10.1007/978-3-319-91908-9_18 fatcat:t3verkvbx5givfekzmbpiw6zla

The RERS challenge: towards controllable and scalable benchmark synthesis

Falk Howar, Marc Jasper, Malte Mues, David Schmidt, Bernhard Steffen
2021 International Journal on Software Tools for Technology Transfer (STTT)  
AbstractThis paper (1) summarizes the history of the RERS challenge for the analysis and verification of reactive systems, its profile and intentions, its relation to other competitions, and, in particular  ...  In particular, the second part proposes a way to tailor benchmarks according to the depths to which programs have to be investigated in order to find all errors.  ...  We were happy to hear that MCC started using some verification tasks of RERS to partially overcome this problem. Finally, VerifyThis [29] features program verification challenges.  ... 
doi:10.1007/s10009-021-00617-z fatcat:i7rvdpbxnjeyxp2ucd377oml7q

Second Competition on Software Testing: Test-Comp 2020 [chapter]

Dirk Beyer
2020 Lecture Notes in Computer Science  
The competition provides a snapshot of the current state of the art in the area, and has a strong focus on replicability of its results. The competition was based on 3 230 test tasks for C programs.  ...  This report describes the 2020 Competition on Software Testing (Test-Comp), the 2 nd edition of a series of comparative evaluations of fully automatic software test-case generators for C programs.  ...  [27] ), and (iii) a competition on interactive verification (VerifyThis [28] ).  ... 
doi:10.1007/978-3-030-45234-6_25 fatcat:hhxrutefwvfrbop2sxwxkf5huy

Benchmarking Software Model Checkers on Automotive Code [article]

Lukas Westhofen, Philipp Berger, Joost-Pieter Katoen
2020 arXiv   pre-print
Our study reveals large discrepancies in coverage - which is at most only 20 compared to results from the main annual software verification competition.  ...  A hand-crafted, simple extension of the verifier CBMC with k-induction delivers results on 63 covers 80 requirements.  ...  We are grateful to Md Tawhid Bin Waez and Thomas Rambow (both from Ford Motor Company) for their support on the case studies in an earlier phase and for fruitful discussions on formal verification and  ... 
arXiv:2003.11689v1 fatcat:ggkfupk7wvhjfgtcmqfn7sb2la

First international competition on software testing

Dirk Beyer
2021 International Journal on Software Tools for Technology Transfer (STTT)  
There were two test specifications, one for generating a test that covers a particular function call and one for generating a test suite that tries to cover the branches of the program.  ...  This paper describes and reports the results of the 1$$^{\text {st}}$$ st International Competition on Software Testing (Test-Comp 2019), a comparative evaluation of automatic tools for software test generation  ...  arbitrary environ- ments (RERS [26]), and (iii) a competition on (interactive) verification (VerifyThis [27]).  ... 
doi:10.1007/s10009-021-00613-3 fatcat:2vuadvp5ebfvxggfsntneubfd4
« Previous Showing results 1 — 15 out of 17 results